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ABSTRACT 


Procedures for Quantitative Sensitivity 
and Performance Validation Studies of a 
Deterministic Fire Safety Model. (May 1987) 
Nadi pekKhoudjalwe.S. Pep imois Institute of Technology; 
M.S., Texas A&M University 


Chair of Advisory Committee: Dr. Waynon L. Johnston. 


The increasing number of users of fire models demands 
their validation by a third party team to investigate the 
reliability of the models with respect to concerns of po- 
tential users. Due to insufficient documentation of the 
subject fire model, verification of it was limited and 
informal. However, quantitative and detailed procedures 
for sensitivity study and performance validation were ap- 
plied. A deterministic model, predicting fire behavior in 
structure, was selected to illustrate partial model assess- 
ment procedures. 

The development and application of two generic method- 
ologies for sensitivity analysis and performance validation 
are described. The subject fire model is FAST from which 
16 input parameters were selected for sensitivity analysis 
study. Comparative graphical results are illustrated over 


Simulation time for the inpvt parameters. 
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Output variables for both sensitivity analysis and 
performance validation were chosen to be the upper layer 
temperature and the smoke layer thickness. These two vari- 
ables, among an array of variables, are viewed to be most 
informative and compromising. A set of 1OOkW fire size was 
chosen with all possible configurations of the experimental 
set ups to conduct the performance validation. A nonpara- 
metric statistical methodology (Mann-Whitney Test) based on 
ranking was utilized. Graphical statistical results illu- 
Strate the quantitative comparison of the fire model's data 


to experimental data. 
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ie GENERAL INTRODUCTION AND BACKGROUND 


Prediction of fire safety attributes is dependent on 
the accumulation of scientific knowledge on the behavior of 
fire. Indeed, before attempting to construct any models 
depicting potential reality of fire behavior, a clear un- 
derstanding of physical and chemical fire phenomena is 


required. 
1.1 Some Fire Characteristics 


The fire process can be perceived to start with igni- 
tion of a given fuel, develop to a peak status, then decay 
to) its? termpnation:s Since hostile fires are undesirable, 
it is quite important to understand the stages of their 
birth and growth in particular. The first stage is related 
to the ignition process which comprises the ignition 
sources, the type of fuels, and the environmental condi- 
tions. The second stage focuses on the fire development 
and growth. It deals primarily with the fire plume and its 
contributions, namely the flame height, the flow distribu- 
tion, the flame, the temperature quotient, the air entrain- 


ment, and the concentration of combustion products. 


PoaeeCOrmatesuseccsllOn choise aqisserrtation tse that, of) the 


American Industrial Hygiene Association Journal. 


Three types of fires are utilized in fire modeling. 
These are the gas burner fire, the pool fire, and the grow- 
ing fire. The gas burner fire is characterized by a con- 
stant fuel flow, which is the same as the burning rate, and 
a constant burning fuel surface area. The pool fire is 
characterized by a constant burning fuel surface area, but 
it has a burning rate dependent on the energy balance at 
its surface. Finally, the growing fire is characterized by 
a variable burning rate as well as a variable burning fuel 
Surface area. For sthis otype | of*efire, dwonition’ is fies 
predictable because of a number of parameters such as the 
necessary heating up period and the pyrolysis period, which 
are more significant for the growing fire. The fire proc- 
ess characterization, through the Knowledge of the fire's 
attributes is required in fire modeling because it serves 
as input and/or as building blocks to fire models. 

Thes (purpose of» thisipchapterowis rto? Hamil iarazeneae 
reader with the primary fire characteristics relevant to 
fire modeling, specifically to zone fire models which are 
the main focus in this study. The following are discus- 
sions of research results efforts on different fire 
characteristics. 

The occurrence of a fire is conditional upon the simul- 
taneous presence of fuel, ignition source, and oxidant. 
Usually, the oxidant in common fires is assumed to be 


abr. Even though most zone models assume an established 


ignition for any type of fires considered, some models that 
involve more than one fuel package require criteria of fire 


spread, i.e., the condition of fuel ignition process. 
weit) LONE LOn-erocess 


It is imperative to recognize that the ignition process 
is composed of two phases, the pre-heat phase and pyrolysis 
phase. 

The heating-up period of a given fuel varies with its 


physical-chemical nature.t4 


The more complex the fuel, 
the more extensive the heating-up period arasuks be. For ex- 
ample, the heating-up time is longer for a cellulosic mate- 
rial than a liquid hydrocarbon; even less time is required 
for gaseous fuels. There is no demarkation line between 
the heating-up phase and the pyrolysis phase; even though 
for most fuels the pyrolysis is initialized at a well de- 
termined temperature. 


It was found that for most fuels, the heating period is 


determined by the following law: 


T. Be AA ace Zoe" t (Ref. 3) 
m(kec) 
where 
Ts. = Surface temperature at time t 
af = Initial surface temperature 


On = Net incident heat flux 

t =, time 

T $e} pees 

k = Fuel thermal conductivity 


= Fuel density 
c = Fuel specific heat 

Note that (hee) is known as the thermal inertia of a 
fuel. 

As the endothermic process continues through the pyrol- 
ysis phase, a positive heat balance should be present; in 
spite of some expected lost flux through conduction, con- 
vection, or radiation. The process of pyrolysis causes the 
evolution of gaseous fuel, which leads to ignition if the 
air-fuel mixture is within the flammability limits. In 
addition, it has been reported that ignition is dependent 
on fuel temperature, amount of radiation applied, and ambi- 


Sigte pressure. 4 


In fire modeling, the fuel temperature is 
assumed to be at "normal" ambient pressure and tempera- 
ture. Therefore, only the amount of radiation to which a 
fuel is subjected can influence when an ignition will 
OCCU: Most room fire models do consider only a single 
fuel package with an established ignition, therefore, they 
do not require the physics of the ignition process. 
However, some zone models handling fire spread scenarios 


need the flame-initiating process information to model fire 


involvement of more than one fuel package. This calls 


attention to the ignition testing methodology. There are a 
number of testing techniques; the two most used are dis- 
cussed below. Testing apparatus used is vertically set-up 
where one of the two parallel panels is holding the sample 
while the other is emitting known level of radiations. 
Note that the pilot flame is located on top of the sample 
panel. This implies that once ignition occurs one would 
expect to observe the spread of flaming ignition downward 
along the panel surface. Similarly, the horizontal testing 
apparatus is set-up where one would observe the oversized 
radiant panel compared to the sample panel, and the pilot 
flame is positioned at the center of the sample. 
Intuitively, we would expect that the two ignition 
testing methodologies would produce different results for 
Similar sample material. The reason seems to be related to 
thevfpachi that vinetorder Jtogobtain® ignition, “the pyrolysis 
process depends on the mass gas rate evolution per unit 
area and the geometry of the testing apparatus. > 
Indeed, KasShiwagi demonstrated that ignition was ob- 
tained sooner for a sample mounted horizontally than one 
presented vertically, because of the convective forces that 
minimized the pyrolysis products. He concluded that the 
required ignition energy is a function of geometric rela- 
tions between the sample (fuel), the convective flame, and 


the radiation beam.®1/r8,9 rece conclusions were obtained 


from radiative ignition of solids and liquids, experiments 


utilizing a black body radiant source and a high power 
carbon dioxide laser controlled energy applied to a sample 


at a single wavelength. 


lee ORs Fine Plume 


Following fuel ignition, ethe s£irev plume? canigbemou— 
served. The properties of fire plumes are important in 
dealing with problems related to fire modeling. 

A number of properties are associated with fire 
plumes. These are illustrated in Figure l. In general, 
one would observe a turbulent flame crowned by a bryant 
turbulent gas stream, which could be smoky depending on the 
nature of the burning fuel. Coupled with the flame and 
bryant gas flow are temperature and plume velocity pro- 
files. Smoky fires would assist in observing the entrained 


fresh air flow toward the fire plume boundaries.+9 


Fire 
plume features just depicted above are qualitative and 
general; they can vary with numerous factors such as envi- 
ronmental conditions, nature of burning fuel, etc. The 
Flow profile above the flame provoked by time average 
values of temperature rise describes a normal distribu- 
tion. The temperature as well as the plume velocity higher 


at the flame level decrease with plume's height as can be 


seen on Figure 1,11,12,13 


EPS AS 


Figure l. Some Features of a Fire Plume (Ref. 10) 


Indeed, it has been reported that a turbulent fire 


14 the first region is 


plume is composed of three regions. 
located at the base of the fuel source. It is usually 
bright region characterized by a pulsation effect that is a 
function of the surface area of the fuel base.1° The 
second region of the fire plume is the fully developed 
turbulent flame. The turbulence increases with the flame's 
height. Finally, the third region is located on top Ofgtae 
luminous parts of the flame, and extends to just below the 
upper control volume. This region is a non-luminous, non- 


reacting turbulent, composed primarily of unclear combus- 


ELON pLOocuccs. 


1.2 Fire Modeling 


As Irwin Benjamin stated, iS ccretsas Being able to predict 
the growth of a fire in a room and its spread through a 
building should be as much a part of the fire protection 
engineers' design tools as predicting the flow of heated or 
cooling air through a building is the tool of the heating 


16 


and ventilating engineer". Prediction is the main thrust 


of enormous efforts required to obtain believable informa- 


tion that modeling can bring.2’ 


In this respect, fire 
models are the products of systematic design of physical 


phenomena aiming at the design of safer buildings. 


Throughout the years, several fire modeling methodol- 
ogies have been used.t8-19 hese include the traditional 
experimental modeling which encompasses small-scale and 
full-scale replicas, and the more theoretical modeling, 
yee, athe mathematical modeling such as stochastic and 


deterministic models. 79 


1.2.1 Experimental Modeling 


Experimental modeling is the most basic type of fire 
modeling. It presents advantages and disadvantages. ie 
offers invaluable insight on fire phenomena, but it is 
usually extremely expensive. and it replicates poorly. 
Experimental modeling can be designed for either full- or 
reduced-scale scenarios. In experimental modeling, two 
primary techniques are utilized, namely atmospheric 


(Froude) and pressure modeling. 


1.2.1.1 Full-Scale Experimental Models 


Experimental modeling conducted on a full-scale basis 
has no equal in investigating realistic fire scenarios. 
Indeed, it provides not only critical information about the 
fire behavior but also noetic communication about the 


structure housing the hostile fire. 


10 


The main advantage of full-scale experimental modeling 
is a realistic simulation of the fire behavior with reason- 
able accuracy in results. Yet, it is eee prohibitively 
expensive which reduces the likelihood of replications 
WOLCNeeLO oCunn Reena ee the possibility of having Stauue= 
tically. significant, results. In addition, full-scale ex-= 
perimentation requires substantial man-power and instru- 
mentation. Also, full-scale experimentation has set the 
stage for fire tests to develop standard fire exposure 
conditions. These tests were intended to determine build- 
ings' partitions fire resistance. Standard testing seems 
to be financially attractive since it does not require the 
use of whole seruecurees yet they are still relatively 
expensive to conduct. Therefore, full-scale exverimenta- 


tion modeling is an exploratory tool. 
1.2.1.2 Small-Scale Experimental Models 


Small-scale experimental modeling is the outcome of 
disadvantages of full-scale experimentations. Small-scale 
models are the product of studies ‘attempting to obtain 
Similar outputs through scale reduction, in geometric and 
thermophysical characteristics of fire scenarios. Even 
though small-scale experimental modeling is plagued by a 


myriad of problems, it has ihe distinct advantages of being 


Ate 


relatively inexpensive and easier to manipulate in a labo- 
ratory setting. 

Accurate scaling is difficult to achieve for variables 
such as linear dimensions, area reductions, volume reduc- 
Pron. ecc. Some variables Simply cannot be scaled, namely 


temperature, buoyancy, etc. 


1.2.1.3 Techniques Used in Experimental Modeling 


Two basic techniques have been used in experimental 
modeling. These are: 

A. Atmospheric Modeling (known also as Froude 

modeling)?’, and 

B. Pressure Modeling.2?/ 
Fluid dynamic scaling laws and diffusion flames are the 
basis of the two techniques.t/ 

Obviously the former technique is desirable for large 
turbulent fires. Smoke and heat movements are applications 
of choice uSing Froude modeling as long as these fires do 
nob exhibit viscousmetfects,,. One.attraction.of this, tech- 
nique is that it does not require sophisticated experiment 
nor structure. 

The latter technique requires an environment where the 
pressure is higher than atmospheric. This environment 


induces a smaller buoyancy force to accommodate the reduced 


scale. Even though this technique offers the advantage of 


dy 


reduced cost, it still requires special pressure vessels to 


conduct fire tests. +8 


1.2.2 Mathematical Modeling 


Through the efforts of estimating fire resistance’ rat= 
ings of fire protective materials from a single (tesr, 
simple mathematical modeling was born. This type of model- 
ing can also be viewed as prescriptive modeling. Recently 


greater efforts have been directed toward the mathematical 


modeling of fires in enclosures. “1 


Fire modeling varies in complexity depending on what 
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information is desired from the models. Some are con- 


structed to determine the fire spread within a single en- 


23 Some other models forecast the spread of fires 
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closure. 
through multi-story buildings. Two basic approaches have 
been used and these are: 


A. Stochastic Modeling, and 


B. Deterministic Modeling. 


1.2.2.1 Stochastic Modeling 


It is a computational approach that views fire growth 
and spread as well identifiable timely events. These 
events are systematically analyzed and quantified through a 


probabilistic evaluation. Even though this approach uses 


13 


no fundamental physics nor fire chemistry, it takes into 
account fire principles when building models. 24145726 

In stochastic modeling two components can be recog- 
nized: the qualitative component which comprises the pri- 
mary aspect Creeice problem; and the quantitative component 


which focuses on those elements of the qualitative com- 


ponent that can easily be quantified. 7//28,29,30,31 
1.2.2.2 Deterministic Modeling 


Primary because of the fact that stochastic models 
Capitalize very little on known fact fire’ physics, it is 
perceived necessary to probe mathematical fire modeling in 


Sy” 


a deterministic fashion. In this respect, from the late 


fifties to the mid-sixties, fire modeling was nascent in, 


respectively, Japan and in England (by Thomas) .°- 


By now, 
fire research efforts focused on the growth and spread of 
fire in terms of its physics and physiochemical proper- 


PS ae 


In attempting to improve fire performance of 
Structures, great attention has been directed to the ex- 
pected maximum temperatures as they relate to time. 

In the effort to gather information on conceptional 
fire behavior, two major methodologies have been under- 
taken. These methodologies can be better expressed as two 


types or models. These are commonly known as the field 


models and the zone models. The first type of model takes 
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the "micro" approach, that is, it divides a well defined 
and limited space into a myriad of space elements.-? To 
these spaces is then applied differential equations depict- 
ing physical phenomena. The second type of models takes 
the "macro" approach, that is, the total subject space is 
divided into only a few spaces known commonly as zones. 4 
Because zones are indeed exaggerated space elements, only 
an approximate set of equations can be used to describe 


their fire related behavior. The following will detail the 


two types of models. 
Lis2 «2ercicluer die LdaMogeds 


Field models, sometimes known as field equation models, 
use partial differential equations applied to element 
spaces or fields to forecast fire variables such as temper- 
ature, smoke particles in space, etc. Field models in fire 
research provide an insight to intricate fire phenomena 


that other models cannot present. °° 


They offer a different 
reaction to the view one would obtain when moving from a 
naked eye observation to a microscopic one. Both types of 
observations are informative. Obviously, field modeling 
falls in the "microscopic" observation category. Iny thas 
category, field models can be either two-dimensional or 


three-dimensional. As expected, two-dimensional field 


models were developed first due to their relative simplic- 


5 


ity. Yet, they still challenge the computing power of most 
existing hardware. This is primarily due to the required 
small time steps in order to obtain a desirable spacial 
resolution. The computation problem is worsened when the 
description of turbulence is added to fluid motion induced 
by the fire consideration. Figure 2 illustrates tempera- 
ture contours for a two-dimensional field model. 24 

Indeed, the forecasting of turbulence, from fluid flow 
provoked by heat induced buoyancy, is a paramount problem 
for modern physics. 24/3/7738 Similar comments can be stated 
about the three-dimensional field models which are cur- 
rently being developed. 

An ingenious experimental simulation has been used by a 


number of fire researchers? 


to model early development of 
fire plumes. This experiment consists of flowing colored 
Salt water into colorless fresh water; this offers condi- 
tions where there are neither heat transfer to boundaries 
(tank wells of fresh water) nor thermal radiation (assuming 


34 In this 


Salted and fresh water have some temperature). 
experiment, the fresh water represents the ambient air, and 
the colored denser salt water represents the hot fire 
plume. Obviously, this experimental set-up needs to be 


visualized up-side-down in order to obtain the actual 


"mushrooming" effect of buoyant fire gases in an enclosure. 
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Figure 2. Temperature Contours for a Two- 
Dimensional Field Model 


ty, 


Field models can be utilized to assist in determining 
fire. parameters at specific locations in an enclosure. 
Figure 3 illustrates sequential temperature contours. Note 
that dimensionless time and grid size are used. Figure 4 
illustrates the effect of irregular enclosure dimensions on 
the temperature parameters. 4 

In addition to the fire growth aspect, Baum has ad- 
dressed the smoke transport aspect in field modeling. 24 
Figure 5 illustrates sequential tracking of smoke particles 
using the same dimensionless time and grid size as in Fig- 
ure 3. Idealized smoke particles (assumed to be of homoge- 
neous size) are tracked as they rise from the fire plume to 
the ceiling of the enclosure. 

One can see that the potential application of field 
modeling is better understanding of the fire growth, fire 
plume, smoke transport, etc. Indeed, once the response 
function of a detector becomes known, then the criteria for 
determining smoke detection can be added to field modeling. 

Field models provide insights of the dynamics of fire 
behavior which assist in the design of zone models. zone 
models can be viewed as a predictive applied engineering 
tool, while field models are a basic predictive scientific 


instrument. 2” 
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igure 3. Sequential Temperature Contours for 
a Two-Dimensional Field Model 
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io ee ee cone. Models 


Zone or control volume modeling takes the "macro" ap- 
proach to the fire safety problem. A fire in an enclosure 
is characterized by two or more control volumes (Zones) and 
a neutral plane demarkating the two zones. The upper zone 
is viewed as the hot zone, the lower is the cool one. 79 
Figure 6 illustrates the above statements. Either alge- 
braic or differential equations expressing the conservation 
of mass, momentum, and energy are used in zone modeling. 
Since zone models focus on indoor fires, vents or openings, 
to either the outdoors or to another enclosure(s), are 
either assumed or prescribed. Hence, smoke flow is a ne- 
cessity to respect the conservation equations requirements 
because deflagrations are excluded. Both single and multi- 
compartment fires are within the scope of zone modeling due 
to the relative simplicity of formulation. #1742743,44 

Due to the "macro" approach of the room fire problem, 
zone modeling recognizes two control volumes in which dis- 
tinctive fire phenomena occur. These phenomena constitute 
the development and growth fire process. This calls for 
the assumption that a fuel is located in an enclosure, of 
reasonable geometrical ratios, and is ignited. Assuming a 
flaming fire, air is drawn to induce a heated rising 


plume. Soon, a hot gas layer starts forming at the ceil- 


ing, which in turn radiates heat back to fire bed. Depend- 
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ing on the nature of the fuel, which plays an important 
role in the incompleteness of the combustion, the hot upper 
gas layer deepens and becomes visibly smoky. The existence 
of openings (doors, windows, etc.) will provoke the hot 
upper layer to: Flow out of the enclosure of origin. Mean- 
while the upper layer was forming and impinging against the 
ceiling, a cool lower layer (largely unpolluted) shrinking 
in size, and constitutes the second contro. vol- 
We nO aa 

One would realize that this is not a static phenomena 
but rather a highly dynamic one. In an attempt to reach 
equilibrium of the different interacting control volumes, 
an exchange of gases among the different zones takes place. 
A time dependent set of flow interchange equations, ex- 
pressing the flow of hot gases from the enclosure of origin 
and the ‘cOrresponding flow of "fresh" air into the enclo- 
Sure, characterizes zone models. 

Indeed, for a given enclosure there is a set of three 
equations in which four unknowns are identified. The first 
equation expresses the timely conservation of mass in which 
the first unknown is the mass of gas(es). The second equa- 
tion describes the conservation of energy and from the 
first law of thermodynamics in which the temperature and 
GacevOluMme alLeoumthemunknowns. es cfinally, the third and last 
equation is the eguation of state, which assumes the pres- 


ence of an ideal gas, and contains the fourth unknown, the 
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ambient pressure. The number of equations and their re- 
spective unknowns increase geometrically with the consider- 
ation of the number of zones, their interface, and the 


number of vents for each Snclasurelue 


In the ee fifties, it was first recognized theme 
strumental relationship existing between both the fire and 
geometry of the events and the air flowing to and ~OusmoE 
the enclosure. Indeed, the heated air in an enclosure 
rises while the ambient pressure decreases with height. 
Furthermore, aS temperature in the enclosure increases, the 
thickness of the upper layer increases and the flow through 
vents increases also. This phenomena is accentuated with 
the nature of fire, fire plume, and the nature of the en- 
closure's boundaries. 4°46 

Fuel package(s) are assumed to be ignited or sustaining 
LONLELON: Yet for most models, they need to be specified 
as a type of fire or as a specified fuel and its respecemee 
burning rate. The above need for specification is relevant 
for the consideration of the interaction of the fire source 
with its environment. Indeed, whenever there iS an energy 
source such as a fire, there are always thermophenomena 
such as radiation, convection and conduction, as Figures: 
illustrates. It turns out that the latter phenomenon plays 
little in the role of heat transfer. process; hence, jonas 


radiation and convection are considered in zone modeling. 
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The energy impact of these two factors are dependent on the 
geometrical characteristics of the enclosure and the nature 
of the fuel packages. In zone modeling, three types of 
fires have been utilized. These are gas burner fires, pool 
fires, and Beene fires. The first type, the gas burner 
fire, is characterized by a: fixed*area fire, by “ag@ige 
burning rate, and by a known chemical composition. The 
second type, the pool fire, is identified by its fixed size 
and by a variable burning rate which depends on the fuel 
energy balance. The last type, the growing fire, which is 
the most complex, is one that requires a number of assump- 
thons. inasOndem ECOmsS i mumaces mice It. requires an assumed 
circular, fuel that increases» an Size ’duejstoejen so eae 
fuel surface as time progresses. As ini pool tires) ae 
burning rate for a growing fire is also dependent on the 
fuel surface heat balance. 297°1,52 

One very attractive predictive feature of most one 
models is the relative. concéntrations of various. toxic 
gases. In essence, only oxygen and carbon dioxide gases 
have been predicted with a satisfactory level of confi- 
dence. Carbon monoxide, on the other hand, has been diffi- 
cult to predict accurately due primarily to the lack of 
full understanding of its production. 2° 
zone models address single compartments, multi-compart- 


hencs - pandismusei—=sStoery fires. #1,46,49 Inorspite:® ofngine 


differences in scope of application, all zone models con- 


oy 


sider at least two -control volumes in addition to’ ibasic 
conservation equations and interaction equations. They are 
all intended to be modular in scope and in application. It 
has been reported that some of them have been used as a 
EQOLEEO Seon ectees hostile fires as part of an investi- 


33,54,55 Zone models are relatively simple 


G@aGion, process. 
to use and most of the computational challenges have been 
overcome. Yet, because of the inherent lack of accuracy 
induced by necessary assumptions used to specify the type 
gt fire .“thegnumber wesizey .and™ behavior tof ezones,-etc., 
zone models need to be utilized with great caution. 

Most users exercise fire models to assist them in pre- 
aqieting ‘readeeritre situations. Most of these situations 
involve HOsStasererues Crom which ‘concernst for human hives, 
Materials, and equipment exist. Hence, the stakes in at- 
tempting to investigate fire scenarios can be high. There- 
fore, providing guidelines and warnings to users when exer- 
cising fire models becomes important. 07>? 

In addition to sensitivity of input parameters infor- 
mation, disclosure of the relative comparison of experi- 
mental data to corresponding fire model output is also of 


paramount importance. This second need was achieved 


through a performance validation process. 
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1.3 Requirements of Fire Models Validation 


As used in this document, "model validation" is the 
process of determining how appropriate a model is for pos- 
sible use. In order to minimize biased model validation, 
the exercise is performed by an intellectually independent 
third party team. It has been reported that model evalua- 


28 Much of the work re- 


tion and its need is increasing. 
ported in. the, literature is qualitative. Therefore, ‘only 
directives on validation procedures were formulated. Gass 
believes that as long as models are used to either make 
public policy or engineering design decisions, there will 
be a need for evaluation.” 
Five major components are commonly encountered in pro- 
posed model evaluation approaches. 2©12//28,60,61 
A. Documentation. This “is an explanation “of 
fundamentals on which the model is based. It 
also includes full nomenclatures of variables 
used in the computer code. The process of 
documenting a model requires the modeler(s) to 
provide information that would allow users to 
evaluate its capabilities and limitations. 
Documentation is intended to provide critical 


information about the model; without it the 


model t:ould be perceived as a "black-box". 


Pe 


En 


Verification. This process is composed of two 
parts. One part requires determination of the 
appropriateness of relationships describing 
the physics of the model, as well as the accu- 
racy of the mathematical calculations. The 
other part is the numerics the model uses. 
The reader should realize that without suffi- 
cient documentation, the verification process 
would be limited or impossible. Verification 
is designed to check model structures, con- 
Sistency and accuracy. 

Performance Validation. This is the process 
of comparing model predictions against experi- 
mental data. Performance validation contri- 
DiGesS CO chew unveil ling@of relative errors in 
prediction. 

Sensitivity Study. This is the process of im- 
posing changes on input parameters while ob- 
serving model response(s). Sensitivity analy- 
sis not only benefits users, but it can also 
benefit modelers. 

Usability. This is the process of establish- 
ing potential model users and their technical 
ability to use them. It also consists of de- 
termining the applications for which the model 


is best suited. 


et, 
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This report emphasizes model validation in the broader 
sense of the term. It simply implies that the fifth com- 
oonent of the evaluation process was omitted. Therefore, it 
is inferred that a validation process is comprised of a 
minimum of eddasuansencte: namely documentation, verifica- 
tion, sensitivity analysis, and performance validation. 
Due to insufficient documentation of the model, the inves- 


tigator conducted only limited and unstructured verifica- 


tion of the model. 


a 
2.+ GENERALSSCOPE 


Constrained by the above limitation Gtcwor] genéric 
methodologies for sensitivity analyses and performance 
validation Br oeese for zone models have been applied. 
Reasonable background of the two methodologies preceded 
illustrations of the respective techniques used to arrive 
at functional formats. 

Section 3 presents the process of performing a sensi- 
tivity analysis on a deterministic fire model. Results, as 
well as major difficulties encountered, are included in 
this section. In Section 4, performance validation is pre- 
sented. It includes fire model simulations and graphical 
aesv CSO mre Stactat ho olcs. Vit also illustrates gqrapnitcar 
comparisons of the data to a sample model output. 

A summary of general conclusions and recommendations 
from both sensitivity analysis and performance validation 
are presented in Section 5. 

Only incidental and limited verification process was 
performed on the fire model Fast4° due to the model's in- 
adequate documentation. Most inferences stated are based 
on the users point of view as well as limited full under- 
standing of physics/numerics of the fire model. Therefore, 


the model was assessed as a "Semi-black box". 


a2 
3. PARAMETRIC SENSITIVITY ANALYSIS 


3ebhe Introduction 


In situations where either safety or unreasonable ex- 
penditures, ‘or both, are of concern; when assessing sthe 
sensitivity of a mathematical model, an alternative method- 
ology is called for to answer the "what if" questions. ©? 
Indeed, the sensitivity analysis probes the effect of 
change in input parameters on the response of the model. 
Since there is no practical analytical solution, investiga- 
tions are possible only through computer experiments. This 
process is also known as computer simulation proc- 
ess, 03764,65 
The expected benefits of the Suggested analysis are 
three-fold. 

A. Warning the user(s) of the model about the 
required care to be taken when exercising the 
model, 

B. Raising questions about the model's "building 
biocks"; sand 

Celi tProveding gedimectimes to which parameters 
should be closely monitored during full-scale 
fire experiments. 


Whenever a mathematical model is built, it is "common" 


to investigate the model's sensitivity. This is true mec. 
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either a deterministic or a stochastic model. A widely 
accepted statistical methodology is known as a (full) fac- 
torial experiment. 

However ,-u one, Otegetheeemmitathonsmwith® ful factorial 
designs is the ne increase (geometrical) of meaSurements 
with the number of factors (input parameters or independent 
variables) considered. This drives the analysis to a pro- 
hibitive requirement of time and effort. The large number 
of required measurements in a full factorial can be reduced 
to a reasonable number of measurements utilizing the meth- 
paelogveocfsa Enactional factorial; alsoiiknowngasra frac- 
tional replicates. 

The alternative solution, a fractional factorial analy- 
SecneeoreCeeCOlaDLeuDVAVL tue toOfecam intrinshe characterrvstic 
Oriseaccol lal lssesigney kKnowmpas. confounding". Indeec, as 
the terminology implies, a number of exverimental situa- 
erons s(treatmentesjogare Eredundant,> that Jisisthey gare con- 
founded with other treatments. For an in-depth understand- 
ing and appreciation of fractional factorial designs, the 
reader(s) ~shoulds consult “thetSworksss off, BoxeHunters and 
Hunter, Davies, and Daniel, ©4766,67 

Most factorial analyses include interactions (groups) 
OL ereccrorseOreincereSiem a truce agwayeor, lookins atitznesmos—- 
sible effect of a group acting in a synergetic way. 

LtiwmiS (9encwell yarag need? the macteichat sinteractiions: (icon- 


tributions) involving higher order interactions can be ne- 
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glected because of: 
Al \Lack?s of*“physical®imeaning fobigthe Sirnterag= 
ELON (Sie anor OL 

B. The difficulty Jofifinterpretationeo£ ithevage= 

ee 

Fractional factorial methodology seems to be adequate 
to obtain information on the main effects and as many of 
the interactions aS appear necessary and meaningful. 
Hence, third or higher order interactions are rarely con- 
sidered. 

In this particulars: study, the number of » factoremece= 
lected for analysis has been limited to 16. Their selec- 
tion was aided by the investigator (relative familiarity) 
of the problem of fire behavior in multi- compartments as 
well as an overall knowledge of the model's operations, 
requirements, and constraints. 

The specific design utilized is composed of 16 factors 
with 1/256th replication requiring 256 measurements or 
computer runs. {GA £ull’factorial experiment!) "for l6éitageore 
would have required 27+6 Or 65,536 replicates of runs, while 
this specific design reduces the total number of computer 
runs to oniyo 256.1); Hence;7 onefecouldsnotice’ that irectiogar 
factorial design leads to saving 65,280 computer runs. 

The fractional factorial designs at two levels imply 
that each of the selected factors has been allowed to em- 


brace’ either ‘one sof!) two) 'chosen ‘valves, Sthat (189 4 “lowe ce 


WWJ 


1a) 


high Level *valuev™ Theserntwo levélsshave been, selected) with 
the rationale that they would represent two different sce- 
narios. A complete description of the selected factors can 
be found in the next section. 

A Mrebtribes partial plan, portraying the synchronized 
levels for the 16 factors, has been extracted from the 


8 and a portion of it is shown in Appendix A. 


Literature® 
Phee part tale@plan Sconsrderse@ blocking twhichwisynote relevant 
in this type of experimentation. Therefore, the plan has 
been viewed as a String of 256 independent observations. 

It is important to note that discussed sensitivity 
analysis is for unreplicated fractional factorial since the 
model to be investigated is a deterministic one. There- 
BoueyaeiO mVAaDLacICRS! imoeoucpuciacan Yoevobtained isromacwo 
identical runs. This implies that there is no value repre- 
senting’ the common -standard, error. However, one could 
provide such an estimate if certain assumptions are made. 
ma eoerticulban, ®if@most Mor e@linchighers« orderannteractions 
would measure differences emanating from experimental 


error, one could provide an appropriate. reference measure 


for the remaining effects. 
3.2 Experimental Design 


The model to be investigated requires a large number of 


input parameters. After careful consideration of possible 
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influences some parameters have on the outputs of the 
model, 16 have been selected for statistical analysis. For 
each factor (input» parameter)! two .levels. were chosen, to 
depict forecasted extreme, yet physically, possible sa 0iue= 
TONS. The selected 16 parameters are external as opposed 
to Ubeingeinsernal Atom themmodes., External parameters. are 
those which the model's user can easily manipulate as in- 
puts. 

Internal parameters are those with which the model 
demands appreciable familiarity of its structure. Indeed 
the study of internal parameters could provide an insight 
on how well the physics the model utilizes reflects fire 
behavior. This research aspect could be the focus of 
another sensitivity danalysis of che. modelts sstructm es 
This would be achieved by manipulating internal parameters 
while holding external parameters constant and proceeding 
with the sensitivity analysis methodology. 

External parameters can be grouped into three cate- 
gories; 

A. Geometrical Data, 

B. Fire Specifications, and 

C. Thermophysical Properties. 

The first category, geometrical data, describes the 
enclosures or compartments basic physical dimensions as 
well as vents or openings connecting adjacent enclosures. 


Compartment dimensions include widths, heights, and 


GJ) 
| 


depths. Vents are described by their widths, heights, and 
Sills. Only the case where one vent connecting two com- 
partments has been considered. The mentioned dimensions 
for the "low" and "high" level have been chosen in such a 
way that the “an eage area and the enclosure's' volume 
doubles, respectively, as shown in Table l. The low level 
values for the compartment geometries have been selected 
with an attempt to describe a compromising typical "hotel/ 
motel" room. The high level values seem to describe remote 
yet possible room geometry. The author likes to remind the 
readers that those high/low values reflect some realism, 
yet they seem to embrace some extremism. NOcemcDatercire 
high level vaiues are simply twite the low level values, 
respectively. 

Also, potential users of the model should note that the 
model is insensitive, by design, to the lateral location of 
Venus. 1c Onivye recognizes the vertical location. Gigs evel aveye 
words, the model will not acknowledge whether a vent is 
located in a compartment's corner or in the middle of one 
Sfe its walls. 

Figure 8 iliustrates a schematic floor plan view of the 
multi-compartment scenarios. On the same figure a sche- 
matic shows how vent's dimensions are described to the 


model. 
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Tabiiena Experimental Parameters 
NAME VALUE LOW 


Geometrical Data 


Compartment Width (m 
Compartment Depth (m 
( 
n 


Wow 


Compartment Height 
Number of Compartme 
Vent Width (m) 

Vent Height (m) 
Vent Sills (m) 


) 
) 
m) 
cs 


Ot*-RPNN & WwW 


Vat Se 


hy 
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Specifications 


eat ot "CompUsed om) (KI /kg) 25 
u Mass Rate (Kg/S) Om 
Position Ce 
lent Temperature (K) 


ty hy “a 


| oe 
ort OD 
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Thermophysical Properties 


Conductivity (KW/mK) 
Specific Heat. (kJ/kgK) O23 
Density (kg/m?) 790 
Emissivity Qs s 
Thermal Properties 
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8.¢ Went-Room Scenerio 


e 
X symbolizes a vent connecting 
*x 


2 adjacent compartments 
symbolizes fire compartment loca 


igure 2. Schematic Floor Pian View of 
Multi-Compartment Scenarios 
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The rationale behind the two-room and four-room scenar- 
io is the simulation of -a—partially simplified archiver. 
tural layout of a hotel/motel arrangement. The two-room 
scenario (Figure 8-a) represents a single room connected to 
amcorridor, wane the four-room scenario (Figure 6=o) em. 
resents a room (numbered one) and a Suite (numbered three 
and four) both connected to a corridor (numbered two). One 
may note that in Figures 8-a and 8-b the corridor location 
is different from what one may usually find in hotel/motel 
settings. There are two reasons for that discrepancy. 
First, the model has no capability in differentiatungeacy. 
corridor location in relationship to the enclosure's loca- 
pions It only requires that different rooms be connected 
by vents. Second, Figures 8-a and &-b, as shown, havemmeer 
Grawn for sake of clarity. 

The second category, fire specifications, is composed 
of the heat of combustion and the fuel mass rate as shown 
in Table l. Arbitrarily, 25MJ/kg and 50MU7/kg have been se- 
lected for the low and high level values, respectively. It 
was assumed a constant fuel mass loss rate as opposed to an 
increasing mass loss rate up to a peak followed by a sym- 
metrical decrease. In other words, the hypothetical situe- 
tion Simply means that the structure will not run ouoeee 
fire energy. Obviously, this situation is not only aii 
realistic, but also extreme; yet the advantage from it 


seems that one could uncover some anomalies by "pushing" 


the model beyond its limits. Also, the ambient temperature 
Palamecem ies been Included Cinetiemstudy and tas been ali- 
towed tO-wary Lrom-al very "coldidaye toirasnotr one. 

The third category, thermophysical properties, is com- 
posed of the EH eenORny seal of the compartments” interior 
bouncGarles,) SUGN aS, COnduCcCtIVity,, specicictihear, Gensity, 
anc ethesmemassivity "of “walls We hWoorsen and iceil ings An 
extreme Situation has also been included, which is the 
perception of no heat loss through the compartment's bound- 
aries. Bre Smascicuation simalameco. consldering chelicom— 


partment as a "thermos" bottle. 
3.3 Methodology 


Because of the relatively large number of computer runs 
required (256), it seemed necessary to develop a scheme 
Gua nomic veemmiescC1cgator nocetonlwPRroeminimize input! error, 
but also to increase the overall efficiency of the study. 
In this respect the following was achieved: 

A. A computer code providing the essence of £frac- 
tronetmmeractorial’ fomeustwo=-tevel «16: ‘Eactors 
encompassing 256 experiments was created. The 
output of this code was named "ZEROS" and a 


sample can be found in Appendix B. 


ie 


A computer code (capitalizing ‘on athe outpuceas 
the above code "ZEROS" to generate the corre- 
sponding 256 input files readily acceptable to 
the source code (the model) was completed. A 
sample of it is illustrated in Appendix C. 

It was decided that among the numerous output 
strings of information, two variables would be 
most useful in assessing the model's behavior. 
These are the upper layer temperature and the 
upper smoke layer. It was, therefore, neces- 
Sary to manipulate the output format in the 
source code in order to obtain a compactuauc. 
put format) "describing fire behaviors: This 
process was important to achieve because of 
the constraints the computing hardware was 
imposing. Over 9,400 records of output were 
expected, and that would constitute a large 
file; which is not desirable. This new format 
was designed to provide upper layer temper- 
ature and smoke layer every ten seconds of the 
total. 360 «seconds simulation time “ine” eae. 
compartment. Ay Sample, of) a typical tormas 
(for a four compartment scenario) can be found 


in Appendix D. 
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D. A computer code wasS created to determine the 
SensSriivity =cOetricrents foreach. OL ithe 16 
Pastors. This task was necessary since there 
is no commercial statistical software package 
Peis, oye processing” a fractional factorial 
experiment with lo" factors, The section en- 
titled "Difficulties Encountered" reveals more 
details on this challenge. 

Each of the four above tasks is discussed in the re- 
Mainder of this methodology section. Some of the informa- 
tion used or deduced originated from extensive literature 
and the reader(s) will be directed to the original documen- 
tation, as necessary. However, it was attempted to provide 
as much information as possible to keep readers not only 
interested, but also aware of the pitfalls the investigator 
encountered. 

Most reasonably, after deciding that only a fractional 
factorial is feasibie and informative to perform sensitiv- 
ity analysis on a complex deterministic model, the next 
Seep, Leading to thes farst™ task, is’ tomdesigqn® at plan to “do 
ut: 

Indeed, a fragmented plan was luckily located in the 
literature search.°8 This plan provided the combination of 


Cieer. On (ance Ow mi eve rs erOrascihic:r LO. actors «Lor, ithe first 
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eight experiments and the first experiment of the restior 
the 33 sets composing 248 experiments. Therefore, it was 
necessary to develop a computer code generating the missing 
231 experiments for the 16 factors at two levels each. 
This. code creates an image recognized by most statistically 
oriented readers as a form of factorial design. ine tise 
code the value "1" symbolizes the high value, and the value 
"O" symbolizes .the fowsavaduemtor seach jfactous The output 
of this»code, termed "ZEROS", can. be viewed  asstassiwe- 
dimensional, matrixmotmuompy 2567. 

The second task was the development of a computer code 
which utilizes "ZEROS" toy)generate. output matenha ngmgiexecu.. 
the required format the model needs to be exercised. Out- 
puts from -this code sbecome- input. files “Gorm etne mec ee 


de. Therefore, 256 input files were produced. These are 


QO 
O 


called RUNOO1l to RUN256. Because of the large number of 
runs, it seemed helpful to create an intermediary computer 
code through which the 256 runs can be submitted to the 
mainframe computer in a few steps. The intermediary com- 
puter code is called "RUNALL". The output of this code is 
a sequential series of dependent variables tabulated where 
the first column is the 37 time steps (first time step are 
the prescribed initial conditions of each run). The second 


column through the ninth are the dependent variables as 
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they relate to the possible four different compartments. 
The output of "RUNALL" ie called "NEWDATA" and can be per- 
ceived as a two-dimensional matrix formed by 9 by 9472. 
Finally, task three utilizes matrix "ZEROS" and matrix 
"NEWDATA" through a computer code, to generate sensitivity 
coefficients for each of the 16 factors. In Appendix E a 
brief and simple methodology illustrates how one may obtain 


sensitivity coefficients or effects of each factor. 
3.4 Results 


As stated earlier, the goal of the sensitivity analysis 
is to determine the relative sensitivity of the chosen 16 
input parameters for FAST. 7° 

Indeed, the results of this section includes plots of 
the 16 main effects as a function of the simulated time for 
the respective two dependent variables (upper smoke layer 
depth and upper layer temperature) which are associated 
with four possible compartments. Therefore, for each de- 
pendent variable and compartment, respectively, one would 
access information from a total of 64 plots. That total of 


64 (16 x 4 = 64) was obtained by plotting the 16 parameters 


for each of the four compartments. 
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Relative comparison for practical -evaluatiion robe. aie 
results is deSirable. For example, by being able to view 
the sensitivity behavior of parameters of interest, one 
would be capable of comparing and ranking the sensitivity 
of those parameters. It followed that for each compartment 
the sensitivity of all 16 parameters are plotted as a func- 
tion of simulated time on the same graph. Hence, for each 
of the four compartments, four plots can be found portray- 
ing the sensitivity behavior over the simulated time. 
These plots are illustrated in Figures 9 to 12 and in fig- 
ures 13 to 16. Because plots of sensitivity over simulated 
time are not always very conclusive, it was believed help- 


ful to determine a discrete average sensitivity value for 


fy 


each parameter. That vaiue iS Simply the arithmetic aver- 


£ sensitivity coefficients over simulated time. 


O 


age 
Figures 17 and-18 illustrate averages of sensivtiv@iiyeae 
efficients over simulated time for each of the 16 para- 
meters.° The.information one could extract from Figuresimagy 
and i8 is a mean of confirming or questioning behavior of 
sensitivit for anv particular parameter. - Whenever the 
sensitivity of a parameter is pronounced over the simulated 


time, the average sensitivity is noticeable also. 
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One would note that the senSitivity behavior of the 
simulated time, for the upper layer temperature seems to 
fan out. On the other hand, one would observe the sensi- 
tivity coefficient behavior for the upper layer depth seems 
to exhibit a Betcen which appears to grow and fan out over 
ChessimuLratedert ime - One may notice that sensitivity co- 
efficients, in general, show similar behavior in compart- 
ments one and two. The same remark applies for compart- 
ments three and four. The reason for this involves the 
benery CiapacterlScic “Offs factorial ‘design mar tworlevel. 
Indeed, only two situations are possible. These are situa- 


tions where a structure has two or four compartments. 
a> CONC LUS pons 


Prommcuesp.Octed restuits ine Figures 13)’ to? 18>) a™number 
Soecet ti celmeonc Usions coutd bem drawn.- By-virtue*thate the 
sensitivity analysis has been undertaken as a function of 
two separate, "“unrelated" dependent variables, upver layer 
temperature and upper depth, two parallel sets of conclu- 
Sions would be expected. The first eset "mi s*ycomposed™= of 
Conclusions 1 and 2; the second set comprises Conclusions 3 
and 4. These are the following: 

imeeecenenaim conclusions =f[Gre the® uppers layer =ten-— 
perature senSitivity coefficients over the 


Simulated time for the respective four com- 


partments, 

2. General conclusions for the upper layer depth 
sensitivity coefficients over the simulated 
time for the respective four compartments, 

oh General conclusions for the average upper 

layer temperature sensitivity coefficient for 
each parameter for the respective four com- 
partments, and 

4. General conclusions for the average upper 

layer depth sensitivity coefficient for each 
parameter for the respective four compart- 
ments. 

Once the set of conclusions is formulated one would be 
able to perceive the trend of the sensitivity behavior of 
each parameter over simulated time. In addition iota 
preceding effort, one could compare the deduced trend of 
sensitivity); to the averaged sensitivity coefficlents iat 
exercise should either solidify or question concluding 
sensitivity statements. it is, expected that... whengyer 
agreement between the first and second general conclusions 
exists, the confidence in the conclusions is qualitatively 
increased. 

1. General conclusions for the Upper Layer Temperature 
sensitivity coefficients over the simulated time for 


the respective four compartments. 


a2 


Using? Figures S)eb0ye ll sand? l27>.0one’ would™-deduce’ the 
following: 

a. Parameter S (thermophysSical properties exis- 
tence) appears to be very sensitive throughout 
thersimulation. period for®aliwcompartments: 

b. Parameter L (Ambient Temperature) seems to be 
considerably sensitive throughout the simu- 
lated time but more so in the first two com- 
partments than the last two. 

ComcParameters/G;, Ho; (0) “and@h “(sitll “height, heat 
of combustion, fuel mass rate, and fire posi- 
tion) show sensitivity behavior during most of 
the “simulation duration in the first two com- 
partments. 

a. Parameter D (number of compartments) seems to 
be very sensitive for the two last compart- 
ments, aS would be expected. 

One should note that the shape of the sensitivity func- 
tion of parameters over the simulated time fans out more 
for the two first compartments than tne last two. There is 
no other apparent peculiarity noticeable from the plots. 

2. General conclusions for the Upper Layer Depth of 

Smoke sensitivity coefficients over the simu- 


lated time for the respective four compartments. 


UsingsRigurces, 135 714.005, 


the following: 


a. Parameter D (number of compartment) appears to 
bey. very, osensditivel im (the. thard! "and&stounes 
compartment. 

_b.,,, Parameters) CC, Eb, eek;...and) S> \(compantmente: 
height, vent's width and height, and thermo- 
physical properties existence) seem to _ be 
quite sensitive. 

c. Parameters J, K, and L (fuel mass rate, fuel 
position, and ambient temperature) show moder- 
ate sensitivity. 

One. should. =» note the jpeculiarity vot @thesemptece. A 


noticeable bulge is displayed 


of thessimulated time vin the compartment sofgorigins 


compartment 


Bs 
he 


ine Sizey and «movesa to 


Simulated time. On 


at 


Neo 


bulge: iis ustill showing, ,bu 


creaSing Simuiation time. 


of complete 


periods correspond to periods where the 


in the former compartment. 
Since the sensitivity of 
the 


simulated=itime; at would 


question the above conclusions. 


(second compartment), 
theserange of )50 .togl50 .seconGsear 
the third and 


dt 


insensitivity behavior. 
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16, and 18, one would deduce 


- 
= 


during the first 50 seconds 
the 
the bulge grows 
the 
fourth compartment the 


tends to: fan-out ‘witheen- 


Preceding the bulges is a period 


These inactivity 


SG pe: 
ae et 


e event is still 
some parameters varied over 
be desirable to support or 


Therefore, parallel to the 


G1 


firstamnc. second, general sconclusivons , the Eollowing? fsa 

set of comparisons of parameters' sensitivity behavior. 

This comparison exercise emanates from the comparative 

sensitivity function over the simulated time (Figures 9 to 

izgsand pighPestad to 16) and from the discrete sensitivity 

function of all 16 parameters (Figures 17 and 18). 

Prose, eu US) crates the third and ‘fourth generals con— 

clusions. 

3. General conclusions for the average upper layer 
temperature sSenSitivity coefficient for each par- 
ameter, for the resvective four compartments. 
HIGUre = leew ust ratesi=sensitivity) value “or each 
of the 16 parameters for the four compartments, 

For upper.ltayer temperature. 

Figure 17 seems to infer the following: 

a. Parameter S (thermophysical properties exis- 
tence) appears to be sensitive for all com- 
partments. 

biea Parameters G pH, eo) Kk, and’ Lo(ventesiils; wheat 
Gr @combustion, fuels massi'rate of rre posraron, 
and the ambient temperature) seem to be moder- 
atelvyersensicive™ for Pthe® firsee® two  comparc= 
ments. 

c. As expected, parameter D (number of compart- 
ments) is highly sensitive for the two last 


COMparements. 
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These three conclusions seem to be in agreement with 
the first general conclusions drawn. Therefore, continuous 
sensitivity behavior seems to be equivalent to discrete 
sensitivity behavior. 

4. General one ia stone for the average upper layer 
depth sensitivity coefficient for each parameter, 

for the respective four compartments. 

Figure 18 appears to support the following observations 
and conclusions. 

a. Parameter S (thermophysical properties exis- 

tence) shows acute sensitivity behavior for 
all four compartments. 

b. Parameter D (number of compartments) expresses 
definite sensitivity behavior i0r 9 tne cae. 
and fourth compartments. 

c. Parameters €C, fF, "G, H, J, K, Lb, ana seems 
partment height, vent's height, vent's sill, 
heat of combustion, fuel mass rate, fire po- 
Sition, ambient temperature, and specific 
heat) seem to be mildly sensitive for the 
first two compartments. 

Again, there seems to be a fair agreement between the 
general conclusions for the upper layer depth over the 
Simulated time and the corresponding conclusions of dis- 
crete sensitivity representation of the parameters of in- 


terest. 
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The sensitivity analysis applied to FAST reveals per- 
sistent sensitivity of the existence of thermophysical 
properties of walls, ceilings, and floor combination. The 
number of compartments is also quite a sensitive parameter. 
Though unexpected, the ambient temperature showed consist- 


ent sensitivity behavior. 


3.6 Recommendations 


The reader should keep in mind that only two dependent 
variables have been utilized to investigate the sensitivity 
of 16 input parameters. The subject model, FAST, expresses 
its behavior through more than two dependent variables 
(upper layer temperature and upper iayer depth of smoke). 
It follows that tnis study could be expanded to determine 
sensitivity using different dependent variables as well as 
other input parameters of interest. 

Indeed, while utilizing the same methodology one could 
replace insensitive parameters by new ones. The present 
Study for example, indicates strongly that the parameter of 
thermophysical properties of compartment boundaries is 
sensitive. The existence or nonexistence of thermophysical 
properties infer the walls, ceiling, and fLOOr, 
Simultaneously. Therefore, one would not be able to point 
SOQewhnichoepart (siea(cetling;, walls; or#floor)eof thervcompart— 


ment boundaries to which the sensitivity is due. Hence, it 
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would be deSirable to determine specifically which ele- 
ment(s) of the boundaries is responsible for the strong 
sensitivity behavior. This demonstrates the need for prob- 


T.45 This process 


ing further “into the gnvestigation of FAS 
would only increase the users level of confidence in the 


model's performance. 


4. QUANTITATIVE PERFORMANCE VALIDATION STUDY 
eiuy Introduction 


When doing research One should always provide reason- 
able and appropriate means supporting the accuracy of 
either measurements or estimations. in ( thessprocesss.of 
assessing the validity of a deterministic model, one should 
quantify findings in terms of the level of confidence in 
these findings. Indeed, the quantification of the fire 
model validation through statistical inference is the focus 
Gee chiswmeLeport. Of course, any statistical inference is 
only as believable as the reasonableness of the statistical 
assumptions postulated. 

Whenever statistics are desired to confirm and support 
a hypothesis, one needs to be concerned with the statisti- 
Saletiata Characteristics. These characteristics usually 
are the number of replications of experimental conditions, 
and the randomness of the data collected. The former char- 
aclenlstic, as i6 ) lLanges enough, inferssehe poss1b1 li tye of 
OVLawningwasGacandistnibution function. This@wouldmlead | to 
a parametric inference test. This characteristic is seldom 
encountered in large-scale fire tests. DuUETEtCO. themehigh 
SostesOleecuesmtescmtuncsrLatter =characteristic, alone, “for 
small samples demands the use of nonparametric statistics 


which are sometimes called distribution-free statistics. 
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A number of practitioner statisticians have contributed 
to developing tests for distribution-free inferences and 


69,70,71,72 tngeed, depending on 


nonparametric inferences. 
the nature of the data, one of the two approaches offers 
attractive methodologies associated to reasonably valid as- 
sumptions. The distribution-free statistical method@iogaen 
do not require specific distribution characteristics. On 
the other hand, nonparametric statistical methodologies are 
associated with the type of hypothesis to be tested. For 
practical purposes, nonparametric methodologies use general 
assumptions and techniques are applied to samples. Such 
general assumptions would be that the population is a con- 


70 Null hypothesis statements are similar 


tinuous (huncwon. 
for parametric and nonparametric techniques, but they Giif= 
fer distinctively in the svecificity of aSsumptionsweeg.. 
porting them. Parametric methods are based on specific 
assumptions about the pdopulation sampled. On the other 
hand, nonparametric methods do not require such specificity 
in assumptions. 

There are a number of key terms characterizing the 
process of. model validation. These are "accuracy", “Eige, 
"agreement", etc.; which are usually preceded by a quali- 
fier such as good, reasonable, acceptable, etc. Associated 
with the variety of model validation processes is the many 


versions of rigorousness in model validation procedures. 


These different versions are differentiated by the embrace 


of different attitudes in the perception of the most in- 
formative way to apply the validation ranging from subjec- 
tives cCO. Partially. quantitative. There iS a presumption 
that the more subjective a validation process is, the less 
Supportive the conclusion on how valid is the model is 
under scrutiny. Based on the stated presumption, the 
author adopted the most quantitative validation process, 
given some limiting validation data attributes. The sig- 
HPretcance level of Jacceptance sor, reyecticon, of the —nulil 
hypothesis would reflect the degree of agreement quantita- 
tively. It is not because one can quantify how accurate 


the estimation of a particular population parameter is that 


ct 


he process becomes an absolute validation of the model. 


=. = ’ 


maeed, the reliability of a statistical decision devends 


HH 


on the accuracy of the experimental data. 

In general, when data is statistically infeasible to 
Poa culate. SpcCinilcmartributron benavior, a nonparametric 
technique would become a very useful methodology since it 
does not require specificity in assumptions. 

Literature clearly shows the more nonparametric a meth- 
Gcolocy 1s) the mores schance to reject the null hypothe- 


Te In fire safety research no evidence was found sup- 


Sisk 
porting a practical quantitative methodology for perform- 


ance validation fire safety models. 


4.2 Assumption of Model Validation Process 


There are two major asSumptions that need to be stated 
and explained, and they are as follows: 

Ve al aon data is (experimental) randomized 

2. Model is perfectly deterministic. Tt sea neon 
hibiting a sample mean or median equaling 
model population mean or median and variance 
equaling zero for both cases. 

The validation experiments described below were random- 


68 That was achieved by considering and 


ized by design. 
arranging parameters such as length of time between each 
experimental burn, the ambient environmental conditions, 
and the physical experimental iayout, etc. More comments 
will follow..on. the nature, size, and .limitationSsso cs. 
Valbdazion data. 

The second assumption may not seem to be one because 
the characteristics of a deterministic model is intrinsic 
to all deterministic models; that is there is no variation 
in output among runs for the same input information. 

Note however, most complex deterministic models are 
built on two major structural blocks of information. These 
are scientific..ohysics concepts..and empirical, phyouees 
phenomena. The former concepts, governed by mathematical 


formula are still deterministic by nature. The second one 


possesses inherent variability. This, variability. LScveu 


rarely exhibited in a deterministic model's output. sulgigtke 
statement is not advocating the inclusion of variability in 
a deterministic model. Note that if it was so, the product 
would be a model partially stochastic and partially deter- 
matiestic. Therefore, for each time step and for each pa- 
rameter of the subject simulation, the model provides 
values reasonably perceived as means with all variances 
being equal and null. Variation on the model also stems 
from variability on the otitput parameters. This character-— 
istic of the subject model, apriori could be viewed as a 
Penatyeagainst ut. sbBut i tecould aiso be viewed that, the 
model niSea Subject to a. stringent ecriteria for statistical 
rejection. 

Having stated and elaborated on the assumptions mean- 
ings, requirements and validation procedures will be dis- 
cussed next. There are three aspects to the model valida- 
tion process, namely, validation data, model simulation, 


and statistical model selection and application. 
4,3 Experimental Data for Validation Purposes 


This section is comprised of the experimental physical 
layout and data acquisition. The purpose of the data is to 
develop a generic methodology for model evaluation. De- 


scription of instrumentation used in fire burns along witt 
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relevant’ information of the statistical “state Of the emacs 
are the subjects of this section. 

A number of scientists at the Center for Fire Research 
(NBS) “labor hard ‘to’ generate useful “and” reliable™ intogmes 
€i OneeOnene ne behavior and its boundaries interactions. 
Monitored and recorded information such as temperatures, 
smoke heights, smoke/air movement, etc. was provided by the 


Center for Fire Research, Fire Performance and Validation 


Group. /3 


Under a prescriptive fire burns program, a number of 
different large-scale fires were designed, instrumented, 
recorded, and followed by a data transformation proce- 
dure. This procedure transformed "raw" data to "engineer- 
ing" readable information. That is information originating 
as electrical impulses is transformed, after proper instru- 
ment calibration, into temperature units, densities, etc. 
he “data is then Standardized and basic ‘statistresmaee 
generated. These statistics are means and standard devia- 
tions for various experimental output variables. Note that 
the transformation of raw data to engineering readable 
information is, in essence, obtained through a mathematical 
model. 

Figure 19 illustrates the burn room - corridor = target 
room configuration as well as the location of different 
monitoring instrumentation. Instrumentation for full-scale 


burns comprises the following: 
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A. Data Loggers 

These are automated instruments which amplify an 
electrical signal emanating from a sensor probe at a 
prescribed rate of instantaneous reading. Data loggers 
collected data averaging over 1/60 of a second to mini- 
mize the existing 60 Hz noise. 
B. Thermocouples 

Extremely reliable and inexpensive, thermocouples 
are widely used in fire research. The several purposes 
they are used for include mass flow calculation and 
heat release rate in doorways. Of course, they are 
also utilized to meaSure ambient conditions. There- 
fore, there are seven locations for thermocouple 
"trees" fas (is iaeustrated in FPigurebio. 
C. Pressure Transducers 

These are instruments to measure air movement. 
High sensitivity is a must to be effective at detecting 
air movement of 1 m/s or less. These instrument probes 
are found at the burn .room, corridor, and target room 
as is illustrated in Figure 19. 
D. Smoke Photometers 

Smoke photometers are used to estimate relative 
smoke obscuration. Referred to as a smoke meter, a 
smoke photometer is composed of light sources, focused 


on a light detector uSing optical techniques. These 


eee) 


instruments were installed in the corridor and the 

target room as can be seen on Figure 19. 

E. Combustion Gas Analysis 

The Knowledge of the precise composition of combus- 
tion products is very desirable. Present gas analysis 
technrrquesmsynehronizedwwwithwexisting instrumentss for 
the analysis do not allow reliable information on com- 

BUSCION Products toxicity. 

However, most information provided included standard 
deviations. Therefore, a user may either choose to consi- 
der the information reliable enough for validation pur- 
poses; or may choose to add a "safety factor" to the given 
data. 

As in Figure 19 where instrumentation was the major 
focus, Figures 20 and 21 differentiate two physical layouts 
of the experimental set up. A five room arrangement as 
illustrated in Figure 20. Similarly a three room arrange- 
ment is depicted by Figure 21. The actualization of a 
three room set up was possible because of the perception 
that the burn room stub corridor and the target room stub 
Cerri dor ase partyvot. thes corridor a physically, This was 
achieved by substantiating the volume of the stub corridor 
and stub target room by an equivalent longer corridor di- 
MEnSion. * shuwsLollowed “thes elteration of “the corridor height 
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Structure = Five Room Set 


to 


is the Burn Room 

Corridor 

is the Target Room 

15 tne Outside. Burn Structure 


1 
2 is the 
3 
4 


PYGULe@ 2. we rhySical Layout orerull=-Scalesrire Burn 
Structure —) ThreemRoomecetmup w(Noc to 
Scale) 


76 


Table 2% Physical Dimensions of Full-Scale Fire 
Burn Structure - Two and Three Room Set 
Up 
LOCATION* WIDTH (m) DEPTH (m) HEIGHT (m) SILL (m) 

il 2.34 2.34 PRN as NA 

2 Loe eS 2.00 NA 

3 2.44 a ad 2.44 NA 

4 0.79 0.94 2.04 NA 

5 Liked 2 2.43 NA 
eee Ooo NA TO 0.0 
2n=i5 Le NA 20 0.0 

3 - 4 OL 79 NA 2.04 0.0 
4-5 Cap i, NA 2.04 0.0 
Senso Le2 NA 2. O83 0.0 

*Refer to Figure 20 
LOCATION* WIDTH (m) DEPTH (m) HEIGHT (m) SILL (m) 

bt 2.34 2.34 ee Es NA 

Z 2.44 NEP Bee) 2%/>.6 NA 

3 2,24 eh SI 243 NA 

1-2 0.82 NA Onao 0.0 
2-3 do. NA 2.04 0.0 
2-4 Lo NA 25.03 0.0 


**Refers tow higuresm2. 


NA = NOT APPLICABLE 


13) 


The input of the model to be validated not only re- 
quires the rooms' physical dimensions but also the thermo- 
physical characteristics of the rooms boundaries. These 
boundaries are the ceiling, walls, and floor. MTheir cor- 
responding thermophysical properties are the thermal con- 
ductivity, the specific heat, the materials density, the 
thickness and emissivity, for each slab constituting that 
boundary. 

Figures 22, 23 and 24 illustrate a sectional view re- 
vealing the different slabs representing ceiling, walls and 
floor for each different location. This type of informa- 
‘tion assists in predicting the expected "heat loss" to the 
ESUFrOUNGINgGSie Note that the burn room boundaries are 
made of materials which tolerate several burn experiments 


with little damage. 
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Thermophysical Properties of Burn Room Boundaries 


CALCIUM CERAMIC Fd RE 
NATURE PSR ECATE FIBER BRICK 
Conductivity (kW/m.K) Ce00010 7 0.000164 0.00039 
Specific Heat. (kJ/kg.K) 1.38 1.04 1.04 
Density (Kg/m-~) 720 128 756 
Thickness (m) a a 02050 Orso 
Emissivity NA Ooi 0.80 


CALCIUM SILICATE 


GYPSUM BOARD 


CYPSUM BOARD 


CONCRETE 


Figurem22. 


Sectional View (A-A) 


ot 


the Burn Room 


Illustrating its Thermophysical Proper- 


ties (Notte Scale 


Thermophysical Properties Of Corridor Boundaries 


CALCIUM GYPSUM 
NATURE SLR CATE BOARD CONGRETS 
Conductivity (kW/m.K) OR GUUS: / Ora000L 7 ONOOR8 2 
Specific Heat (kJ/kg.K) nheclts 1.09 ste 4ne)e 
Density (Kg/m-) 720 930 2280 
Thickness (m) Om Oe 7. OPO mle Gh Agarg ey 
Emissivity NA 0.90 0.90 
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Figure 230. Sects Cnalgaviewes(b-Bie ofeathe Corridor 
Ia Ustratincants® Thermophyvsical Proper-— 
ties (Not to Scale) 
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Thermophysical Properties of Target Room Boundaries 


GYPSUM 
NATURE BOARD CONCRET. 
Conductivity (kW/m.K) Onr00017 0.00182 
Specific Heat, (kJ/kg.K) 1.09 1.04 
Density (Kg/m-) Oe0127 0 sbG2 
Thickness (m) 930 2280 
Emissivity 0.90 0.9C 


GYPSUM BOARD 


CONCRETE 


Figure 24. Sectional View (C-C) of the Target Room 
Illustrating its Thermophysical Proper- 
ties (Not to Scale) 
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The actual full-scale fire burns were undertaken for 
three (3) different fire sizes, namely 100, 300 and 500 
kW. For almost each fire size, two different physical 
configurations of the layout were utilized. Referring to 
Figure 19, one would imagine the use of a door to segregate 
diverse compartment. With the burn room present and open 
to the remaining of the structure, the following matrix il- 


lustrates the physical layouts achieved. 


CORRIDOR 
| OPEN ! CLOSED | 
| , | 
| CLOSED a5 e.8 Z | 
TARGET : 


ROOM | 


In total and among the three fire sizes, nine sets of 
different physical configurations were performed with 


varied replication as it can be seen on Table 3. 
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Table 3. Summary of Eight Sets of Fire Tests for 
Three Fire Gases and Different Con- 
figurations 

SEL FIRE CORRIDOR TARGET NUMBER OF 
NO. SIZE DOORWAY ROOM REPLICATES 

Mi 100kW Closed No 4 

2 LOOkW Closed Yes 5 

3 LOOkKW Open Yes 8 

4 300kW Open No 3 

2 300kW Closed Yes Z 

6 300kW Open Yes is 

ry 500kW Open No > 

8 500kW Open Yes 3 


&3 


For each burn experiment, a procedure determining the 
initiation and the completion of the experiment. This 
procedure is composed of the following: 

A. Pilot light period of approximately 300 seconds, 

B. Main Sepa period of approximately 600 seconds, and 

C. Cool down period of approximately 300. seconds. 

Even. ethougn,! ther perlodsoft Minteres t sist ‘thelmainwburn 
period; ~the two. (2) others iplayeimportan® roles Ther pilot 
rants period is necessary Stoestabilize@monitoring: ainstru- 
ments. In order to insure that the instrumentation is 
Still sensitive enough to be used in another test, the 
cooling down period was used. Data was recorded during the 
three burn periods. 

As Table 3 indicates, set 1 possesses the largest num- 
bere=or Yepticates’, “but 'Trotylarge Menough “ok construct a 
mougnm dystribution- off atchosen variable. This important 
ime tat?on practically? rules -ouce parametriovtreatmentil of 


the data. 


4.4 tatistical Experimental Design for Performance Vali- 


dation 


Wien pthnerstatasticalwnavune Off theetvalrvdationviere data 
in mind, the most appropriate statistical test to validate 
Bnies mode UOnsee known — asi¥thesnmlcoxcnas test. /0,71,72,69,74 


Wit cOxOn-S" testySise@Mcalitéed ar Wdistrroution ‘free test: be- 
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cause there is no need to define/know the distribution of 
the populations or samples. In this case, these two 
samples are the experimental data and model data samples. 
From paired samples, inferences are made for their respec- 
tive Decne sionse 

Again, the major reason for selecting the nonparametric 
test (Wilcoxon's test) is based on the inherent robustness 
of its general assumptions and the lack of a priori know- 
ledge of the type of distribution representing the sample 
data. This test is deSigned primarily to be a test detect- 
ing location differences. This could,.be they, differences or 
two medians of two different samples (experimental and 
model samples). 

The Wilcoxon's test will be oresented through its at- 
tributes, such as ranking properties and related distribu- 
tion properties of linear ranking statistic. 4 a tir essence, 
the test succeeds to quantitatively describing the degree 
of acceptance that the median of sample A is different than 
the median of sample B. This is done through the ranking 
of the values of sample A and B. The difference in ranks 
between samples A and B would reflect the acceptance or 
rejection of the hypothesis. 

Formally stated, two independent random samples, Air 
Ao, Az,...A 


and B,, Bo, B3,.-- B, emanate from two popula- 


n Mm 


tions with’ continuous cumulative. distribution. stunctions 


F(A) and F(B), respectively. The combined samples A and B 
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then become a Sample of n+m (ntm=N) elements to be ranked 
promuds to, Ns 

Mathematically stated, the new ranked sample can be 
mepresentedus>y al vector sZ.9 Ins thiss context ,mwelementss of 
samples A and B, are viewed as having binary properties, 
meen Zero, 40)"or ones (1). 8 “Hences, vector’ Z) canbe. written 
as Z= (2), Zo, Z3r-e2-Zy), where Zy0 Zo, Z37-0+Zy could be 
emeiiere.0- Orel. In other words, the Z vector becomes the 
rank-order statistic which leads to a class of statistic, 


Garvied the linear rank statistic. The linear rank statis- 
tic is usually defined as 


N 


where 2 iswoecined as the indicator ‘random. variable. 


In the following the mean and variance of Wy can be com- 
Mean = m(Nt+_l) 


Variance = mn(N21) 


m 
the minimum value of Wy is: =>. i = m(m+l) 


i=l zZ 
N 
the maximum value of Wn 1s: = 1 = m(2N-m71) 
i1=N-m+l 2 


Once the linear rank Statistic is determined, one needs 
to refer to the appropriate table for a given n and m and 
record the probability value for rejecting the null 


hypotnesis. 


Having some background for the theory of the Wilcoxon's 


test, let us illustrate “Its utility’ “using” ay nonemeuees 


example. 
o. 4 typi Cal=Appl rca om Of" Wis Coxon, Test 


Data has been collected from two groups of industrial 
OuUtpPUC LOL "a" Spec lice pLOoauct. Among numerous factors 
affecting the “quality of* the product,” one = attriputemaae 
been investigated. The first group ‘of eight’ producrse, 
treated group, waS produced by a new manufacturing 
process. The second group, control group, was produced by 


74 The correspondance of 


the old manufacturing process. 
treated and control groups parallel model and experimental 
data, respectively. 
There are two assumptions to be reasonably met. These 
are: 
A. Two random samples taken independently of each 
other, and 
B. The two populations have roughly the same proba- 
DiLTcCyeahS.cr Out vom. 


Data: Quality attribute of control and treated products 
DOr foayiree 
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Treated Group Control Group 
ZO eee 
Ze Syeda} 
ae Fe siete) 
Zou yes pa 
Pts de 
Pago io) wae 
Psy | rapa 
Sey @ i ge) 

a ete 
io 
oe 
digas 
eae; 
ZU 
ny = 8 M5 = 14 


The treated group sample is merged with control group 
sample, ordered and ranked, as illustrated below: 


TREATED & CONTROL RANKED 
SAMPLES ORDERED CONTROL TREATED 
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te 
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Sum OLeranes <p ewco so 
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If the medians of the two samples were equal, the sum 
of ranks calculated would equal the average value of the 
Wilcoxon statistic. This value is, calculatedaia, 
n(m+nt+l)/2, where n is the number of observations in the 
treatment abet = and m is the number of observations in the 


control sample. By comparing W the average Wilcoxon 


avg’ 


statisbici witose the calcubated’ sum ofsR0ukK jew there are 


cacy 
three possible inferences. They are: 
A | 
Petre £ Weale Wavg! a number of observations from the 
treatment sample are large in magnitude. 
Bie oie Wealci’ Wayg! a number of observations from the 


treatment sample are small in magnitude. 


all observations from the treat— 


@) 


eS TeeAy aes 
ig uot ole: Wavg' 
ment sample are equal to the median of the control 


sample. 


The average value eee is then 8(8+1441)/2 92, while 


the calculated sum of ranks is Wea 2 Onto 

The results of the test statistic include a point esti- 
mate for the difference between treated and control 
medians, as well as a confidence interval for that point 
eStimate. These are illustrated below. 

Two independent random samples from two populations 


have medians 1 and 5, respectively. The appropriatemuaes 


hypothesis can be stated as follows: 


a 9 2 2» , against the non-null hypothesis 
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Hy = er Ae tao 


It should become clear to the reader that the statisti- 
cal hypothesis is expressing the median location problem. 

Using the Gre from the previous example, the two 
sample rank procedure yielded to the following results. 


Note that these results have been obtained through a pre- 


Packaged statistical routine. 7° 

Treatment N = 8 Median = 2.5500 

contro! N = 14 Median = 1.7000 

PeOOLiemeac mate fOr 5 = ois 0.7000 

A 94.% confidence interval for Ve we) pops Suet Uepec Ure ee 10 0) 
Test 4 =? » es eS #12 > 

Woe 12 G5 


Ppecmces eisesigniticant at U.02z04. 


Typically, the Mann-Whitney test determines medians of 
che two samples. One can observe that these are different, 
but in addition, the significance level of the test leads 
to the rejection of the null hypothesis. One is 95% confi- 
Gent that the chance of observing two samples having dif- 
ferent medians when in fact the two populations have the 


Same median is only 2.04%. 
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Therefore, one would confidently conclude that from the 
evidence of day 1, the new manufacturing process did, in- 
deed, affect the quality of the oroacces In order to be 
persuaded that the new manufacturing process affects the 
quality of the product over time, one needs to collect data 
in days 2, 3, 4, etc. and perform the Mann-Whitney test and 
display respective significance levels as depicted in 


Figure 25. 
4.5 Methodology 


The methodology for the performance validation study 
consists of exercising the fire safety model "FAST" to 
simulate similar experimental conditions for which full- 
scale data exist. The model simulation is designed to 
emulate output most relevant in describing the behavior of 
the model that reveals its performance agains real fire 


data. 
4.5.1 Model Simulation 


The subject model in this exercise known as FAST ver- 
sion 174° is a deterministic, multicompartment, two zone 
fire model. The model is based on a number of assumptions; 
the most important one requires that two distinct control 


volumes for each compartment or room exist. 
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Figure 25." Significance: Level of -the Wilcoxon Test 
LOrIVaAL tao emOre rnteresty Over Time 
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There are four input categories to be considered in 
executing the model. These are: 1) simulation time and 
time-step, 2) configuration and floor plan data, 3) thermo- 
physical properties of the compartment boundaries, and 4) 
fire specifications. 

A. Simulation time and time step 

This entry requires the length of the fire simula- 
tion and how often a printout is wanted. To match the 
experimental output records, 600 seconds are needed as 
the simulation time with a 10 second time step. 

Be. Conirqaurecvonmana tloor plan vdata 


This part requires the number of rooms, their di- 


mensions and the size of their connections. The 
ambient temperature is also needed. The model assumes 
ambient pressure. Table 3 provides most of the re- 


quired input for this category. 
C. Thermophysical properties of the compartment 
boundaries 
There are five properties composing the thermo- 
physical characteristic of the boundary. Namely these 
are conductivity, specific heat, density, thickness, 
and emissivity of each slab constituting an element of 
the compartment boundaries. There are three elements 
comprising each compartment; the ceiling, walls and 
floor si. The five properties, for each slab, must be 
inputed moving from the inside of the compartment to 


the outside. For example, from Figure 22 which il- 


lustrates a cross sectional view of the burn room. For 

the walls, one would input the ceramic fiber thermo- 

physical properties data before the firebrick proper- 
ties data. 

De fire specifications 

FAST iS a model that uses a prescribed fire. 

Indeed, it needs to be told the heat of combustion of 

the fuel, its location, and combustion efficiency. One 

advantage in dealing with a prescribed fire is having 
the flexibility to manipulate the heat output rate. 

One could also choose between a growing, decaying fire 

or a steady fire. 

The fire energy the model requires iS expressed in 
terms Of .the™total calorific, value” of the fuel (heat of 
combustion) for a given scheme of time intervals, asso- 
ciated with the respective fuel mass loss rate. Figure 26 
illustrates the input information as the model format re- 
gQuires it, for a lOOkKW size fire with the burn room and 
corridor configuration, for a two room scenario. (recall 
Migure: 21). For this pilot study, the statistics for two 
output variables will be analyzed, the upper layer tempera- 
ture and the smoke layer thickness. The graphical output 
can be seen on Figure 27 and Figure 28 for the upper layer 
temperature and the smoke thickness, respectively, for the 


burn room. 
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VERSN 7 SEs OFs285 100KW,CD DOOR OPEN 
TIMES 600 18 10 6 @ .1 
NROOM 2 

NMXOP 1 

TAMB 295 

HI /F 8.0 08.8 

WIDTH . 2.34 2.44 

DEPTH 2.34 12.80 

HEIGH 2.16 2.44 

HVENT 25 CES OC mE ORG 
HVENT 2 Ae O2) 2aCs re ene 
CEILI 


COND .008 


164/.000117 .00017/.000117 


SPHT 1.04/1.38 1.09/1.38 


DNSTY 128./7268:. 930./728. 

THICK i.e SY xOn 27 .@127/.0127 

EMISS .97 .98 

WALLS 

COND .800164/.008398 .60017/.000117 


SPHT 1.04/1.04 1.89/1.38 


DNSTY 128./758. 930./720. 
THICK .@50/.113 .0127/.0127 
EMISS  .97 92 
F LOOR 
COND .8802398 .0817/.000182 
SPHT 1.04 1.89/17 .04 
DNSTY 750. 932@./228e. 
THICK .113@ .8127/.182 
EMISS  .8@ 98 
LFBO 1 ROOM OF ORIGIN 
LFBT 1) TYPE Cine ipe 
LFPOS 1 CENTER OF ROOM 
CHEM! 1.8 @.8@ .75 .25 @.6 5@63@. 293. 
LFMAX 1 
FT IME 620. 
FMASS .882@5 .08205 
FHIGH ieee 
Figure: 26. FAST" -Input’ File as) Required yebyge oe 
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Model simulation is simply the process of gathering the 
appropriate data from the full-scale experimental set up, 
and obtaining for each time-step and variable,one single 
value representing the sample of the model. 

Having the first statistical sample through model simu- 
lation, the next step is to prepare the two samples for the 


statistical model application: 


4.5.2 Statistical Model Application 


This section will illustrate the application of the 
Wilcoxon test (Mann- Whitney Test) using samples from the 
model-+and the experiment. For each time step selected, 
data elements (treatment sample) and experimental sample 
(control sample) are prepared for analysis. For each out- 
put variable of interest, a set of samples is set up for 
statistical analysis. A numerical example will partially 
illustrate the Mann-Withney test methodology. Finally, the 
numerical example results will be briefly discussed. 

Among the numerous output variables, two were selected 
from the point of view of a user aS opposed to a scientist 
or modeler(s). These are the upper layer temperature, and 
the smoke layer thickness. A modeler would be interested 
in flows of air and smoke, energy balances, etc. Investi- 
gating these other output variables would certainly shed 


some light on weaknesses of either the physics of the model 
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or its numerics. Yet when one, aS a user, iS concerned 
with fire safety and life safety of a real fire SOO 
these selected two output variables could be reasonably 
informative to assist the user to assess the hazards of 
that scenario. Therefore, for each time step and each 
output variable a statistical test will be performed. 

For each fire size simulated, either 240 (60 time steps 
times four (4) output variables in simulation of set 1 or 
540, (60 times steps times six (6) output variables in 
Simulation of set 3 and 4 pairs of samples are produced, 
(model and experimental). One can see how the number of 
samples reached substantially large proportions. 

For each variable and location, a pair of samples for 
each time step win be generated. As an example, a lLOOkW 
fire for a configuration excluding the target “roomevanad 
keeping the corridor doorway oven, will illustrate the 
Mann-Whitney statistical treatment. The time steps 


selected are 10, 20, 40, and 60 second state of events. 
4.6 Performance Validation Results 


The results presented in this section are not intended 
to validate the FAST model per se, but rather they are the 
product of detailed procedures necessary to validate any 
fire model. It is a fact that the deterministic fire model 


utilized in this study is FAST version 17. Since FAST is 
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presently (December 1986) under review by a number of 
special committees, it is not appropriate to use these 
results to form an opinion on the performance validity of 
the model. Therefore, a systematic performance validation 
exercise would be neither meaningful nor productive at this 
time. 

With the above statement in mind, the l00kW fire size 
became the focus of the applied performance validation 
procedure. The l00kW fire was selected because it is the 


case where all possible scenarios were treated, as Table 4 


Peruscraces. 
Table 4. Validation Data Sets Characteristics 
Characterization Set l Set 2 Set 3 Set 4 
Fire Size (kW) 100 10060 100 100 
Number of Replications 2 2 5 8 
Corridor Doorway OPEN CLOSED CLOSED OPEN 


Target Room NO YES NO YES 


100 


Similarly to the sensitivity study, results are pre- 

sented graphically because of sheer volume of output. For 
each compartment or room in the AAs statistical 
output for the chosen two variables are plotted. 
Figure 29 Ser utes Figure,,32 .illustrate, the. stazienaees 
treatment of time dependent calculations. These calcula- 
tions depict how experimental and model samples performed 
and probable inferences on the their respective popula- 
tions. 

Detailed tabular data and statistical results follow 
Figures 29 through 32 to illustrate the nature of the range 
of statistical Significance of the test. This Tangemmine 
cludes both underpredietion and overprediction situations 
for selected time - steps and key parameters in the burn 


rOOmMmOr Set iL. 
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4.7 Conclusions 


Due to the nature of the experimentation, three pos- 
sible situations become apparent. These are: 

A. Prediction of the model falls within the range of 
experimental data. This situation will be termed, 
arbitrarily, as the accurate prediction region, or 

Be. Prediction Off thes models fallsmico: the left of the 
experimental data. This situation will be termed, 
arbitrarily, as the underprediction region, or 

Cee) Prediccione Otesnemmogel eral ls) top the righty of the 
experimental data. This situation will be termed 
arbitrarily as the overprediction region. 

If one could obtain additional experimental data and 
perform statistical analysis, it would be expected to en- 
counter a shift from one prediction region to another. 
Therefore, it would be conceivable that a major data change 
would reverse the present conclusions. ineeedattiroOn, mele 
should be syaerdey Chace Cal Sm iOtunt ne SDYeéacol data chat 
influence the significance level but rather the rank of 
individual observations. For example, suppose that 
Originally the rank of the experimental median was 5.5, 
while the rank of the model median was 6.5 which induced a 
Significance level of 80%. Now, if additional experimental 
values were provided, both experimental and model medians 


would change which may or may not change, the significance 
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level. However, the significance level would increase if 
experimental and model median ranks get closer. Similarly, 
the significance level would decrease if the experimental 
and model median ranks get farther apart. 

The criteria for performance validation of a determi- 
nistic model seems to be lenient, in regard to how well the 
fire model performed against experiments of full-scale 
testing. Indeed, a deterministic model would not be under 
binary constraints of a pass/fail basis. In light Gimere 
scheme of under, accurate, and overprediction of the fire 
model, Tables 9, 10, 11 and 12 illustrate the time-varying 
behavior of chosen parameters for respective locations and 
sets of data. Note that the point estimate and thestespecs 
tive confidence estimate interval are both null for all 
analyses. This is due to the nature of observations of the 
model sample, that is, they are all identical. 

From Tables 5, 6, 7, and 8, one may~conclude) Thea. 
lowing. 

A. Burn room-corridor with corridor doorway open ex- 
hibits reasonably accurate prediction for primarly 
the burn room. 

B. Burn room-corridor with closed corridor doorway 


exhibits general underprediction. 
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C. Burn room—corridor—target room with corridor door- 
way closed exhibits a reasonable accuracy for the 
DUDE LOOM tne Lremaln noe ocat fOns= GOmcir OUCiM@rd) 
underprediction phase (100-150 sec), followed by a 
brief accuracy phase (50-100 sec), finally a sub- 
stantial overprediction phase (200-400 sec). 

De sDULIY LOOM  —scornmMuior = eterget., TOOM- with fcOrridor 
doorway open exhibits reasonable accuracy for the 
burn room. The remaining locations portray general 
underprediction. 

In general, one could conclude that there is a reason- 
ably accurate Peat ec hone mates enes burn | room, \ifor salt 
scenarios. Scenarios where the corridor doorway is closed 
exhibit more underprediction than overprediction. Similar- 
ivy, "scenarios where the corridor doorway is open exhibit 
more underprediction and overprediction but with less de- 
Wace LON. 

4.8 Recommendations 

To enhance the robustness of the Statistical 
methodology for performance validation, one would need to 
consider the following recommendations: 

A. As expected, an increase in the number of replica- 
tion of experiments is highly desirable. A range 
of 12 to 15 replications would make the experiment 
more informative. This would also increase the 


accuracy of the model against reasonable experi- 


Oo 


ES, 


mental data. Because of expenditure and effort 
required in full-scale burns, it is suggested to 
focus on extreme fire sizes. It is suggested to 
generate an experimental data base that would focus 
on et fires and large size fires. For example, 
100kW and 500kW fires with respectively larger 
replication numbers would have more benefit than 
gathering data from 100, 300, and SOOKWeRigeee 
characterized by relatively fewer replications. 
Once timely data are obtained, it would be very 
helpful and informative to do a preliminary analy- 
sis through descriptive statistics. This exercise 
could potentially assist in selecting proper sta- 
tistical methods to treat data. 

Because of the clear trend of poor accuracy (orm 
model beyond the burn room, it is necessary to 
verify the model assumptions and equations. In 
particular, flow entrainment appears to be a major 
influence on temperature and smoke density predic- 
tions beyond the burn room. Therefore, either a 
systematic or a selective verification could reveal 
potential changes needed to improve predictions of 


the model. 


dee? 
5. GENERAL CONCLUSIONS 


In order to further fire science and to encourage the 
use of fire models, users should be aware of the sensitiv- 
Behe Be ehs) the Seer Users also should be informed of 
the level of accuracy for variables of interest. 

The ‘general conciusions, “from both ‘in<depth studies, 
namely validation studies, are summarized below. 

Users should exercise care when exercising fire model 
(FAST version 17) for the following input parameters. 

A. Thermophysical properties of boundaries of enclo- 

sures, 

B. Fuel and its characteristics. Fire "locations ws 

also included, and 

Cee Ace Duces) Obepiysical. height of rooms and ‘eight 

openings. Increasing the number of rooms is dis- 
couraged. 

the level of “accurecy in tpredicting behavior of fire 
attributes in a multi- compartment structure is dependent 
upon the physical configuration considered. 

For a comparatively small gas-burner fire (l100kW), the 
fire model did reasonably and accurately predict upper 
layer temperature and smoke thickness in the burn room. 
Beyond the burn room, the fire model prediction of both 


upper layer temperature and smoke thickness were poor. 


Sage 
6. GENERAL RECOMMENDATIONS 


To improve the quality of fire models and to address 
the urgent needs of the paramount problems of fire safety 
in cols aero the following recommendations must be 
stated and acted upon. 

Parallel to the studies undertaken, two sets of recom- 
mendations will follow. The first set of recommendations 
focuses on the nature of the sensitivity analysis. The 
second set addresses issues on the consequences of the 
performance fire model validation. 

Once more, it must be stressed that it is extremely 
important to provide complete and sufficient documentation 
as well as conducting: a verification exercise of theme 
model under scrutiny. In addition, the following must be 
considered: 

A. Focus on the apparent sensitive input paramenters 
such as the thermophysical properties of the en- 
closures' boundaries. 

B. Determine a proportionality relationship of those 
establihed sensitive input parameters. 

C. Investigate input paramenters not considered in 
this present study and perform the above two tasks. 

Since the zone model utilized to conduct the per- 
formance validation has been the subject of a re-evaluation 


of its basic assumptions, physics, numerics, it would be 


JESS) 


useful to initiate one or two options. 

The first option is to "retire" the present zone model 
ad focus on the development of an "improved", well docu- 
mented, verified zone model. This improved model would be 
based upon ene present model with the inclusion of the 
state-of-the-art fire research findings. This model would 
ideally integrate functional building features such as 
atrium, smoke detection, heat ventilation air conditioning 
(HVAC) systems and sprinkler systems. 

The second option would be to solidify the present zone 
model by providing complete and sufficient documentation, 
Ver ume noe 1C, Ponds Dyes ix ingest coSe piys CS mand/or™ numerics: So 
that it predicts what is theory, it was supposed to predict 


accuratel 


ie 


file: 


en 


[Oe 


Vhs 


120 


REFERENCES 
Mar tuLTieecies DLbiusion Controlled. Ignitione Jor 


Cellulosic Materials by TAESAGE Radiant Energy, Tenth 


Symposium on Combustion (International), The Combustion 
Institute, Pict csourgn ye awl. 405 le 


Blackshear, P. L., and Murtz, K. A.: Heat Transfierega. 
From, . and Within .Cellulosic. Solids Burning =ingear 
Tenth Symposium on Combustion (International), The 
Combustion Institute, Pittsburgh, PA (1965). 


Carslaw, H. S., and Jaeger, J... Ces sConduction onmaieat 
in Solids, 2nd ed, Clarendon Press, Oxford, (195975 


Van Dolah, R. W., Zabetakis, M. G., Burgess, D. Sipeeane 
SCOR ts ai en ens Ignition..ores the, Flame-Iinitiacine 
Process, U. S. Department of Interior, Bureau of Mines, 
athe Wake & iss 


Silva ious Cellulosic Panels - Small-Scale 
Ignitability Test for Large-Scale Applications, Western 
States Section, Combustion Institute, Pittsburgh, PA, 
(not published), (1974). 


Kashiwagi, T.: Effects of Attenuation of Radiation on 
Surface Temperature for Radiative Ignition, Combustion 


Science and Technology, (19/79) Vol. 19 ps pope ee 


Kashiwagi, T.: Experimental Observation of Radiative 


Ignition Mechanisms, Combustion Science and Technology, 
(1980) Volk. 343 opeesa—244. 


Kashiwagi gle: Ignition of a Liquid Fuel under High 


Intensity Radiation, Combustion Science and Technology, 
(L980)> Vode ee OOnmL od i 


Kashiwagi, ml. : Radiative Ignition Mechasims' for 


Solids,. Fire Safety Journal, (1981) Vol. 15, pple 
2550 


Heskestad, Gunnar: Engineering Relatioins for Fire 


Plumes,. Fire SafetysJournal, (1984) Vol. 3, ppueeeoe 
2008 


McCaltrey ane . nce: Purely Bouyant Diffusion Flames: 
Some Experimental Results, NBSIR 79-1910, Center for 


Fire Research, National Bureau of Standards, 
Gaithersburg, MD, (1979). 


ies 


jer 


14. 


lige ye 


16. 


ate 


eS. 


o's 


20. 


Zale, 


geeks 


Zo 


deAyl: 


Heskestad, Gunnar: Peak Gas Velocities and Flame 
Heights. of. Bouyancy..= Controlled sTurbulents Diffusion 
Flames, 18th Symposium (International), The Combustion 
TNSCITULe PP OUSDULON, eae (LOO L). 


Kung. Boe Cope eandwolayr Lande aoe 7: Bouyant Plumes of 


Large-Scale Pool Fires, 19th Symposium (International), 
Bittsburgh MA a (1.96 2)7. 


Zukoski,l ce Ew; Kubotz, 2 Ae and Cetegen, Bie 
Entrainment in Plumes, Fire Safety Journal, (1980/81) 


Mol. 3, 4.DpsLouu=tee 


Markstein, G. sho: Scanning - Radiometer Measurements 
of the Radiance Distribution in PMMA Pool “Fires, 


RC80-BP-4, Factory Mutual Research.Corporation, 1151 
Boston-Providence Turnpike, Norwood, MA, (1980). 


Beny.aminyes lec: Iiemeeucure Of Fires Protection 


Engineering, Society of Fire Protection Engineers 
BuUPlLetin ye Sls, aul Ute oo. 


Hacnway, We wl: Survey of Fire Modeling Efforts with 


ADQeICatiOnwstOm  LanclDOntatione Vehicles) WU%) SS. No. 
DOT-TSC-OST-81-4, (1981). 


PGAaCOc hea aD  eancemporeese,,. U. Ns Computer Fire 


Modeling for theseeeredarcoron. ‘off .Flashoverr NBSIR 
82-2516, National Bureau of Standards, (1982). 


Friedman, R.: SaalLusmeOn. Mathematical Modeling = of 
Fires, FMRC RC £82-BT-5, Factory Mutual Research 


Corporation, 1151 Boston-Providence Turnpike, Norwood, 
MA; (L982). 


Parikh, Disy ey eeley Gels m0 wake, ana CuriStian, aie. ml. > 
Survey of the State-of-the-Art of Mathematical Fire 
Modeling. COR Mtnemisocl ely MoOGePlasticmindustryey Inc, 
New, LOrKk, NY 7 Uboo oye 


Levine, R. S.: Proceedings: Ad Hoc Mathematical Fire 
Modeling “Working (Group, Fire’ Technology, 20,92, 47, 
(May 1984). 


Kawagoe, K.: Fire Behavior in Rooms, Report No. 27, 
Building Research Institute, Japan, (1958). 


Friedman, R.: Status of Mathematical Modeling of 
Fires, FRMC «= RCoy 8d-BT—5) Factory Mutual Research 


Corporation, 1151 Boston-Providence Turnpike, Norwood, 
MAY, SLE SOU ee 


24. 


Zl 


Zo. 


IAT pF 


Z8i 


Pale 


30% 


es 


BZ: 


Boh 


34. 


55% 


122 


CaravatvViy ssh 4b peel, Wee eres A New Approach to 


Fire Codes, Architecture and Engineering News, (March 
1970 )« 


General Services Administration, Appendix D.: Interim 
Guide for Goal-Oriented Systems Approach to Building 
Fire Safety, Building Fire Safety Criteria, Washington, 
By erty buh Wi py'4, U9. 


Wrison, ROPE ANG! Boucharcs D. "Re: Fire Safety System 
Analysis, Children's Hospital National Medical Center, 
Washington, D.C., Second International Fire Protection 
Engineering Institute, University of Maryland, College 
Parks” (Mayil9 755% 


Ben-Ali-Khoudja, N.: Application of Digital Computer 


Programming for Evaluating Fuilding Fire Safety, Master 
Thesis, Texas A&M University, (December 1982). 


ROUX-paer to wee Systems Concepts for the Fire Protection 


in] Structures: II, Presented at the CIB Symposium on 
Fire Safety in Buildings: Needs and Criteria, 


Amsterdam, The Netherlands, (June 1977). 


Harmathy, T. Z.: A New Look at compartment Fires, Part 
LT, F1Le TeCHnOL OO vemmOy et oO— 2. 7, Loge 


Ferguson, J. B.: The Derivation of a Systems Approach 


to Safety Performance Requirements, National Bureau of 
Standards;~Gapthersburg, MD, (1972): 


Watts, Cees A Theoretical Rationalization oF a 


Goal-Oriented Systems Approach to Building Fire Safety, 
Ph.D. Dissertation, University of Maryland, (1978). 


Markatos; 70N. Of@. ,erand | Malin’, M. *R. ¢ Mathematical 
Modeling of Buoyancy-Induced Smoke Flow in Enclosures, 
Int. “Journal of Heat “Mass Transfer, 25,91), 65=7 098 
(1982). 


Cobni,siui mPa Firefighting in the Computer Age Using 


Math, Computer Models _ to Study Fire, NBS/Dimensions, 
Volo C65 ENO. so crae 


Baum (O° RLY Rehm, eReaGa,..and- Mulholland, "Gee 
Prediction of Heat and Smoke Movement in Enclosure 


Fires, Fire SatetysJ0urnal, wO,;meul loo). 


Thomas, P. H.: The Size of flames from Natural fires, 
Ninth Symposium (International) on Combustion, New 
York, Academic Press, (1963) pp. 844-856. 


SOs 


Saks 


idce 


cate 


40. 


41. 


42. 


43. 


44, 


45. 


46. 


dupes 


Hjeretager, B. H., and Magnussen, B. F.: Numerical 
Prediction of Three-dimensional Turbulent Buoyant Flow 
in a Ventilated Room, Hemisphere Publishing 
(al geloke-ymyolgyy Gf EMA od A 


Van Dolah, R. W., Zabetakis, M. G., Burgess, D. S., and 
CCC piers sae ans Ignition or Flame-Initiating Process, 


Fire: technology,” 6, (1963). 


Hertzberg, Nee Cashdollar, Kn; L2tten, cae and 
Burgess, D.: The Diffusion Flame in Free Convection, 
Report of Investigation 8263, U. S. Department of 
Interior, Bureau of Mines, (1978). 


Rockett, UA. se renivace Communications; July, 1986. 


Emmons, H.: Tieieet cOuUCerONeeOL Flite 11 bUlLaIngsS, 
Seventh Sympoisum (International) on Combustion, The 


Combustlonp itis cist Ut Syasrec cc SOULCD PA 2 /(19.78.)r, 


Cooper, Lay eca culacingeaAvailable SaresEgqress Time 
(ASET) -—A_computers Programasand..Users: Guidei,), National 


Bureau of Standards, Gaithersburg, MD, (September 
LOS Ze. 
ROCKO CC wee, sand MOrme-cay, M.: The-,Harvard/N. B.S. 


Multi-room Fire Simulation Model, National Bureau of 
tandards, Gaithersburg, MD, (To be published). 


Mise ee ae NC MMON Ss asl We ¢ Documentation for 
CrCe 2 ie eit tiemarvana Computer Fire? Codeymcontract 
LO National. .,Bbureauwio£t s Gtandards, fiGaithersburg, MD, 
NBS-CGR-81-344, (October 1981). 


SOOUCl a lnciel net etme is: En Experimental Study of Upper 
Hot vuaver Stratificationeins f£ulld-Scale!sMulemroom Fire 


Scenarios, National Bureau of Standards, Gaithersburg, 
MD, 20th Joint ASME/AICHE National Heat MTransfer 
Conference, (1981). 


Jones, W. W.: A Model for the Transport of Fire, Smoke 
and Toxic Gases (FAST), U. S. Department of Commerce, 


National Bureau of Standards, Center for Fire Research, 
Gaithersburg, MD, (1984). 


Tanaka, Takeyoshi: A Model of Multiroom Fire Spread, 
U. S. Department. of ,~Commerce,) National, Bureau of 


Standards, Center for Fire Research, Gaithersburg, MD, 
Abe BS GCL) LA 


1 a 


48. 


49. 


ae 


Die 


52s. 


holy 


oe 


hehe 


=) is 


Sor 


124 


Bukowski, Richard W.: An Introduction to Fire Hazard 
Modeling, U. S. Department of Commerce, National Bureau 
of Standards, Center for Fire Research, Gaithersburg, 
MD, (1968). 


Christranyfew<s Room Fire Models, State-of-the-Art 
Review, Society of Plastics Industry, New York, (1983). 


Jones, W. W.: Application of Fire Growth Model to 
Corridor Smoke Filling Experiment, U. S. Department of 


Commerce, National Bureau of Standards, Center for Fire 
Research, Gaithersburg, MD, (1981). 


Kashiwa, <0.: Effects of Attenuation of Radiation on 
Surface Temperature for Radiative Ignition, Combuston 


Science and Technology, (1979). 
Orlore ysl. Simplified Radiation Modeling of Pool 


Fires, 18th Symposium (International) on Combustion, 
Waterloo, Ontario, Canada, (1980). 


Modak?; (Ac. Tt sands Groce rar. Ass Plastic Pool Fires, 
Combustion and Flame, Vol. 30, (1977). 


Williams, S. J., and Clarke, F.B.: “Combustion -foun. 
TOXSCuys Dependence on the Mode of — Produce 
Generation, Fire and. Materials, Vol.—6, Nos? 2eang ss) 
(1982 ye 


Short, Ge -W..,, "McGuire; "0d. A.” Hutcheon, oN. aoe 
Beqqetyiw Reams The. St... Lawrence— Burnsy —“Nekerees 
Ouarterly, 53 ,. 4a 36, (Apri le loaojs, 


PIGMENG 2 nett ee Analysis of Potential Fire Sprinkler 
Performance in the Great Adventure Fire, Fire Journal, 
CL9S 4). §VOllL 62° DD as a4 a2. 


U. S. General Accounting Office: Guidelines for Model 
Evaluation, PAD-79-71, Washington, D.C., (1979). 


Grunk, 2303/2 ange iit eel see Methods and Examples _ of 


Model Validation - An Annotated Bibliography, MIT-EL 
78-022 WP, MIT Energy Lab, MA, (1979). 


GaSo uu teen nee Validation and Assessment Issues. of 
Energy Models, Presented at the NATO Advanced Research 
Institute, Application of Systems Science to Energy 
Policy Planning, Brookhaven National Laboratory, 
(1979). : 


ais 


60. 


on 


62. 


63% 


64. 


G5-. 


66. 


6a). 


68. 


69. 


Ribs 


125 


Goldman, N. L., and Gruhl, J.: Assessing the ICF Co9al 


and Electric Utilities Models, Validation and 


Assessment Issues of Energy Models Workshop Proceed- 
ings, NBS@eSPgg569,4 National, eBoreau rsotmyStandards, 
Gaithersburg, MD, (1980). 


Kresqent? Diu ties An Approach to Independent Model 


Assessment,. Validation and Assessment Issues of Energy 
Models Workshop Proceedings, NBS SP 569, National 
Bureau of Standards, Gaithersburg, MD, (1980). 


Wood, D. O.: Model assessment and Validation: Issues, 


Structures, and Energy Information Administration 
Program Goals, Validation and Assessment Issues of 


Energy Models Workshop Proceedings, National Bureau of 
Standards, Gaithersburg, MD, (1980). 


Box, George E. P.; Hunter, William G.; and Hunter, J. 


Stuart: Statistics for Experimenters, An Introduction 


to Design, Data Analysis and Model Building, John Wiley 
SeSons jet LOT ea 


Pristsker, A. Aw, wand, Pegden, C. Dae: Tne rOcuGtLOnRMmCO 
Simulations ands suAM,moystems: Fublishing: Corp (1979) 


Shannon: fa lows Systems Simulation the Art and 


Science, 2rentice—Hall eiincee, 461975). 


Swartz, -lu. As; et’ “al: Binal slechnicaleeRkeports on 
Pun Ugg ve nolmutat1on Model, Voll; sell sand» LIT} 


prepared by National Fire Protection Association, 
(TOS Ly 


Davies, Owen L.: The Design Analysis of Industrial 
Experiments, Hafner Publishing Co., New York, (1963). 


Dans ei,.. cuthbert ADD ELCA pLOnS ee OfumoCALISTLESE tO 
Industrial Experimentation, John Wiley & Sons, (1976). 


National Bureau of Standards Applied Mathematics 
Series: Fractional Factorial Experiment Designs for 
Factors at Two Levels, U. S. Department of Commerce, 
Washington; ) Dt Comoe. 


Noether, Gottfried E.: Elements of Nonparametric 
Statistics, JOnn Waeeyv es sons, aonce, 801967)" 


Gibbons, Jean D.: Nonparametric Statistical Inference, 
McGraw Hill, Inc., New York, (1971). 


ria 


TES 


To 


74. 


126 


Hettmansperger, Thomas P.: Statistical Inference Based 


on Ranks, John Wiley & Sons, (1984). 


Hollander, Myles, Wolfe, A., Douglas: Nonparametric 


Statistical Methods, John Wiley & Sons, (1973). 


Peacock;  R. ‘D.. eteeali: Experimental Data for Model 


Validation,. U. S. Department of Commerce, National 


Bureau of Standards, Center COLD Fire Research, 
Gaithersburg, MD, (to be published). 


Ryan, -T.0 AS) -Jr., Joiner,) By b., “and Ryanye cee 


MINITAB Student Handbook, Duxbury Press, MA, (1980). 


APPENDIX A 


This 


Eraccional LaClroriar USingmaoG. factors. 


extracted from a Government publication. 


appendix 


APPENDICES 


illustrates the 


partial 


die A9 


plan for 


This plan has been 


The plan was 


labeled 256.16.8 which symbolizes 1/256 replication of 16 


Factors) ini 3s2 Diocks: Of -e7untes. each. 


Pactors:s 


Completely 
Randomized: 


PLOCKS ¢ 


ie 
(2) 
bdghjlmn 
cefgjklmops 
bedefhknops 
acdefhklmp 
abcefgjknp 
adghjos 
ablmnos 


14 
aegjln 


18 
bekmnp 


eZ 
acdfgjlp 


K, i, M, N, OF Py Se 


All two-factor interactions except CE, CE, 
FK are measurable. 


CEs CK, SS EK, 


2 
bcefghkl 


al 
abcdefghjklmn 


8 
adlo 


Meas 
cdegjno 


As 
abfhklimo 


L9 
efgop 


5) 
abdehklmnop 


3 
jimno 


6 
adjmn 


9 
cdeglm 


ily) 
bdfhjklno 


as 
acegmo 


20 
behjklop 


24 
acdfgmnop 


4 
bcefghjkmno 


: 
abcdefghko 


10 
bdfhkm 


1) 
abfhjkn 


Ly 
cfglmnp 


2m 
abdehjkp 


25 
defnp 
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26 26: 28 29 
bcedghklnp defjmop ‘ bedghjkmop abcghjkmp 
30 au 32 
aefjp abcghknop aelnop 


NOTE: a) The symbol (1) is used to specify that all 
factors are at low level 


b) The presence of a letter indicates the high 
level of that factor; its abscence denotes the 
low level. For example, in block 32 (aelnop) 
treatment aelnop indicates that A, E, L, N, O, 


and P are set at high-level: and B, C, D, F, G, 
H, J, K, M, and S are set a low-level. 


APPENDIX B 


From the plan illustrated in Appendix A, 256 treatments 
Or run scenarios have been generated and a sample from it 
follows. 

Note that there is no blocking involved in this study; 
the labeled blocks were used for convenience only. Each 
block “is “comprised )oOpmeevghnt (3) ‘runs: The following 
Appendix (Appendix C) is the result Block 21, RUN2, for the 
high/low levels assignment, as it is stated at the end of 


RUNO21. 


Block 20 
O: aeth 
ee 
alge 4) 
Lame 
Oped 
O* ah 
G0 
OG. gel 

Block# zr 
eel 
0 «1 
GO. pe0 
Oo mel 
Tyne 
ay eel 
Le ge0 
1 


O27 OF eee nO 
oe OS Ome 
Cay Ih eee 
Om Of vie 
br Oem © 
07 Lae 
LY Os Ome 
ie Le Ole 
Oi Peer a 0 
Ry tee OSE 
Op 0a 20 
OO eels ae 
eS et oe 
0» 0tst eno 
es Lem L 
ie Ou BOT 


Figure B-l. 


PartlalbeOQutpit. ofr 1le sZ2EROS” 


ISOS) 
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APPENDIX C 


From the generated computer file (ZEROS) a compute: 
program was designed to produce the respective 256 runs. 
Those runs have been set up in such a way that they include 
required system commands (CYBER 205) followed by the 
required format the model needs to be exercised. 
Capitalizing on the planned modularity of the number of 
created files, a set of complex system commands has been 
completed to run all of the 256 runs using a two step 
procedure. Also, individual runs can be selected to 


produce any output of interest. 


VERSN 017 MULTIPLE CONNECTED COMPARTMENTS 
TIMES 30 0m0 0 er lilw Ue Cameo: 
NROOM 4 
NMXOP 3h 
TAMB eames) 
HI/F Oren. O'S" £0241 308 
WIDTH Tour. 0” 7eeO lay a0 
DEPTH Seri. 0 on0merC 
HEIGHT 2itak 2) Elio Beet 
HVENT e220 bes Some. GC 
HVENT 2ipae 2.09 1ee> ee 
HVENT Sok! 20 een ie 
HVENT Awe 2 Oe LS eae 0 
Chit 
COND -UCOpoe,OUG Loe OUU LS). 00018 
SPHT 9 ao ag fo 
DNSTY 120m 719098 79098790 
THICK Um oO see met oe 01s 
EMISS 5 eee See AD 
WALLS 
COND ~UOORS 2000 Low eo00LeS .00018 
SPHT te Meee bangles AAS) 
DNSTY iG 190/90 2 °790 
THICK Coe ODOM OS 420095 
EMISS ae) GRR. ~ elpe. wlewe) 
FLOOR 
COND BU ese eno wom 0018s. 00018 
SPHT apes mm, See 979 
DNSTY (lee) D0ee 730, 79.0 
THICK eo OL om a0 15% Oe 01'S 
EMISS Ow. 59 mae ORAM, 9 
LFBO 1 ROOM OF ORIGIN 
LFBT Le DY OE. OR FL RE 
LFPOS iL 
CHEMI UM Um eUmU OmmOr 0500006300 
LFMAX al. 
FTIME 900 
FMASS 004 004 
FHIGH oELET oa 
CO aU Z 
Olimar 02 
A SUMMARY OF BLOCK 21 RUN 2 {SEES FILLE {RUNS 62) 
AsB C D@EL EMG co Je Ke Gaencn. 0; Pes 
Ol Lar lee O ae Slo Om Omnium ee Oe | 
Figure C-l. Input File - Run #162 
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APPENDIX D 


The, following »is* a typical output that .jhaseebeen 
modified to form an eventual matrix (ALLDAT) composed of 
nine columns, and these are the following: | 

A. Column 1 represents the simulation time steps with 

ten (10) second increments up to 360 seconds, 

B. Columns 2, 4, 6, and 8 are the upper temperature 

values for rooms 1, 2, 3, and 4, respectively, and 

Cs; «Columns. 3, 15,57, and: 9 ware -the upper Layensivanuee 

for roomss1, @yiicyirand 4, respectively. 

Note that time step starts with the number "1" which 
symbolizes the invtval *simulation «conditionse.ia ee 
time-step zero (0). 

Figure Del illustrates » a rcomplete outpute > ope 
two-compartment scenario, followed by the start of an 


output for a four-compartment scenario. 


} 
iW 
J 


1 273.6 @.@8 273.0 ¢@.08 
11 334.8 €©.16 273.6 6.06 
21 347.5 @.55 273.8 €.00 
31 360.0 €.84 273.1 €.60 
41 368.8 1.08 273.1 6.08 
51 ‘371.8 1.04 279.5 6.81 
6) S76sim (4211) 20243" 6..e3 
71 380.9 1.17 298.5 €.08 
Bi |SB5.64 3:21 Se2.6 e. 14 
Si 390.69 1.255. S065) Be) 
161 396.8 1.28 318.8 ~ €.33 
Li enseS 92 81. 5\) 31477 1, 47- ° 
{Zima eae) 370 9y 8263 
T3i9 416148 VSS) Sedre2 2 628 ; 
141 425.5 1.33 524.€ 6.98 
1S Yee S27 Sen SoM car Seat tS 
161 9439.6) 91,354, 333.45) 1522 
17h 445566 ie 340 S396) 28 
18a S226 tT, 359544 008 1 SZ 
191 458.2 1.36 350.3. 1.34 
261 464.45  YeS7 ee SS549 41.35 
254 2470. 465 23-38  361.7 1436 
22. 47 Oe Sen S672 6) 1. 36 
251 S48) BM PSER STIG 6136 
241 487.3 1.38 378.8 1.36 
254, 492.4 . 41.39), ,386;1 _ 1.36 
2bimaci. 4 Mi cSBe SU2os yl ob 
ga Del. Ems eSbWcSSESSe 1.35 
231, S@6sS SE 40455 ist 
ZeeeOiCo7 S038 410.4 8391.3 
Bhi 5340.6. S65 4165294 34 
ore OG 2 my seemed so 2 3 534 
Seimei ee ie Somes 2727 1533 
Blge5240B gyi eSB 2433 414 pda cd 
iS) hyere, WA Ce) ais ee 
Sim 550.4 et 37 443.6 94.32 
SGaeSS2.9 ee ecreasee.S 861.32 
1 330.0 6.80 3386.0 ¢@.00 33e.6 €.08 338.8 ¢©.8e 
real? Pom Calsu S25. 7 8.00 529.5 » 8.00 325.5 6.98 
21 428.4 ©.47 328.7 @.00 329.3 @.00 329.3 €.08 
31 438.5 ©.73 328.7 6.06 330.e@ €.00 329.3 6.00 
41 448.0 @.95 328.7. ©.08 230.0 @.00 329.3 €.00 
51 451.1 1.01 33@.0 ©.00 330.6 @.00@ 3229.9 ¢€.08 
61 456.1 1.10 346.3 €.@5 23e.@ €.0@ 2329.3 €.20 
7A) £46326) 40228 “3601501 (6.249 . 330.0) .ecest Sze )3"h Je. 8d 
81 469.5 1.38 367.5 €.54 329.3 @.e8® 328.3 6.88 
91 474.1 4.35 371.4 ©.587 329.3. @.0@ 328.3 €.08 
101 475.7. 1.37 372.6 1.01 ° 338.8 6.08 329.9 ¢@.0¢ 
134477 Om oom oe475)) 1.13 332.65 26162, 329°3 > —e.06 
i 2ige4Ben Se ease S7oeOe 1 26se 557.65 ROU 1S me S25-5, 6. 80 
Iai 400 2m 47m SS4Ner 12 G2) SSo.O" O29, 525352" 6, ee 
Th 40S (Se) Seer Bee st) 35) 341.2) 0245. 529.5. , CL OP 
151m) 487 S3eee 1-540 SS 2e i -36yn 34D ELe.60e 32875 ce,ee 
Figure D-l.Complete and Partial Output for Two- 
and Four-Compartment cencrass, 
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APPENDIX E 


The output from the 256 runs stored in a file (NEWDATA) 
in conjunction with file ZEROS lead to the calculation of 
the sensitivity coefficients. For illustration purposes a 
fictitious simple example is utilized to illustrate how to 
generate those coefficients for a two level factorial 


experiment. 


Let usS consider a given system where among itS numerous 
parameters, four are the focus of a sensitivity analysis 
study. These parameters or factors are A, B, C, and D, 
respectively, and serve as inputs to the system (model) of 
interest. In addition to the four parameters, two 
interactions are to be investigated. This illustrative 


example is for 16 treatments or runs as shown on Table E-1l. 


Followed by Table E-l are two typical calculations of main 
effects and interactions to determine sensitivity 


coefficients. 


NES 


Table E-l. Factorial Matrix and Response of System 


FACTORS INTERACTIONS 

Treate Re- 

ment A BeaG Dea ABs BD ABC SZ ABDS ACDSGABCD — sponse 
Bs O OFF OTRO i 1 O O O 1 ria 
2 1 One O gnO O iL: a a uh, O 61 
3 O ek Oa ge) O O Ll 1 O O 90 
4 1 nea 18 ai O O O a Ae 82 
= O eres 26 ie ae L O ii O 68 
6 Re OF= LL O O a O i O 1 61 
7 e) OT ee O O fe) 1 Hi nH 87 
8 iE Le One 1 O 1 O O O 80 
2 e) Om Ogee. aL e) O a ak e) 61 
10 1 OF Oar ) O uf O e) ab 50 
jou O Nagy a al O us af O i ui 89 
ee Mi pal ah 1 ne O ai O O 83 
es ) Oa ul, 1 O 1 ue O a 3.5) 
14 us Oi Ome O O e) O Hl: O ave 
15 e) eee O L O e) O O 85 
16 Ay ae Oe ds a” 1 a uE He 78 


NOTE: 
it Symbolizes high level value allocation for 
respective factors and interactions 


0 Symbolizes low level value allocation EOL 
respective factors and interactions 


Calculation oLfemain effect Bb: 
(-71-61+90+82-68-617467+80-61-50+89+83-59-51+85+78) /8=24.00 
Similarly, the calculation of interaction effect ABCD: 
(+71-61-90+82-68+87-80-614+50+89-83+59-51-85+78) /8=-0.25 
Because of the absence of an estimate of standard 
error, interactions ABC, ABD, ACD, and ABCD have been 
selected to be used to obtain an estimate of standard 
error, asSuming that the three and four-factor interactions 
are negligible. This estimate is a measure of the 


differences emanating primarily from experimental error. 


Table E-2 summarizes the effects of single factors and 
their interactions, followed by Table E-3 showing relevant 


values leading to the standard deviation calculation. 


Table E-2. Summary of Effects for Single Factors 
and Interactions 


Factors and 


Interactions Effect 
A -8.00 
B 24.00 
ic =2725 
D -5.50 
AB 1.00 
BD 4,50 
ABC -0.75 
ABD 0.50 
ACD -0.25 
ABCD -0.25 


The closer the effect of factors and interactions to 
zero (0), the less sensitive they are. That constitutes 
the basic criteria for sensitivity. It follows that factor 
B is more sensitive than factor A, etc. Note that the 
higher in order of interaction the lower the absolute value 


of the corresponding effect. 


Table E-3. Higher Order Interactions to Estimate 
Standard Error 


Interactions Effect (Effect) 
ABC -0.75 O35 625 
ABC e5'0 On2500 
ACD -0.25 0. G65 
ABCD -0.25 -.065 


TOTAL = 0.9425 


Ley 


Table E-4 Summarizes the factors and interactions of 
interest as well as their respective effects and standard 
deviation. 


Table E-4. Summary of Estimated Effects with 
Their Standard Deviations 


Factors and Standard 


Interactions Piftecet Deviation 
A -8.00 ming’ 
B 2:45:00 a Tews 
C -2.25 m0 220 
D -5.50 ee ie 
AB iL. 80 a 30in20 
BD 4.50 me TO AD 


Apriori, factors A, B, and D seem to be most senSitive, 
because of the relatively high effect values. Also, 
enteéracti One ol erappears: ) toes ben sensitive’, for /thes.same 


reason. 
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